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MSIPS5 


Comprehensive Guide 


MSIP 5 Overview 


The fifth version of the Missouri School Improvement Program (MSIP 5), the state’s accountability system for 
reviewing and accrediting public school districts, outlines the expectations for student achievement with the 
ultimate goal of each student graduating ready for success in college, career, and life. The comprehensive MSIP 
accountability system was established in 1990 and has evolved with each version. MSIP 5 Resource and Process 
Standards are designed to promote continuous improvement and innovation within each district. The Process 
Standards are often qualitative in nature. The MSIP 5 Performance Standards are designed to recognize the 
achievement and continuous growth of ALL students as they prepare for a global economy. 


MSIP 5 is also used to distinguish the performance of schools and districts in valid, accurate, and meaningful ways so 
that districts in need of improvement can receive appropriate support and interventions, and high-performing 
districts can be recognized as models of excellence. Annual Performance Reports (APRs) are based on the 
performance standards and are reviewed for accreditation purposes at the district level. The state also produces 
APRs for schools and charter LEAs to support its goal of empowering all stakeholders in manners appropriate to 
their roles through regular communication and transparent reporting of results. 


The adopted MSIP 5 Standards represent the work of hundreds of educators. Numerous refinements and revisions 
were made before the State Board of Education approved the final changes. The standards will guide Missouri's 
continuing school-improvement efforts. 
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Changes to the 2019 Annual Performance Report 


The 2019 Annual Performance Report will look significantly different this year. In keeping with the purpose of the 
APR, the changes will communicate the state’s expectations; distinguish the performance of schools and districts; 
empower all stakeholders with information; drive improvement and innovation. The APR includes critical questions 
pertaining to the standards set out in MSIP 5. 


The Department of Elementary and Secondary Education (DESE), will also implement the following changes in the 
2019 APR data: 


1. 


Science 
Standards Applicable - Science Only Standards 1 and 2 


Updated Policy - Three years of data will be included in the calculation of the MAP Performance Index (MPI) 
and the progress calculation. Due to the administration of the 2018 science field tests, the calculation will 
include 2016, 2017 and 2019 data. 


In 2019, new science assessments were administered at the fifth and eighth grade level, in biology end-of- 
course and physical science end-of-course. As a result, DESE will release secure science data to districts and 
charter schools in mid-October with all public data being released in November 2019. 


Social Studies Field Test (2019) 
Standards Applicable - Social Studies Only Standards 1 and 2 


Updated Policy - DESE administered a field test for social studies assessments in 2019. Field tests are not 
designed to return data used for accountability purposes. No social studies data will be provided in 2019. 


Selected Residential Facilities Exclusion 
Standards Applicable - All 


Updated Policy - Pursuant to section 167.128, RSMo, DESE is prohibited from aggregating the data of 
students who reside in an institution for neglected or delinquent children, who reside in a court-ordered 
group home, an institution for neglected children or an institution for delinquent children for purposes of 
Missouri School Improvement Program (MSIP). This provision of law became effective August 28, 2018 and 
will be implemented for the first time in the 2019 APR. 


Students who have been reported as neglected or delinquent by school districts or charter schools will be 
removed from all standards in the APR. These data will be aggregated into a single APR as required by state 
law. 


Selected residential facilities include: 

Institutions for neglected children and youth are public or private residential facilities, other than a foster 
home, that operates primarily for the care of children and youth who have been committed to the 
institution or voluntarily placed in the institution under applicable State law due to (1) abandonment; (2) 
neglect; or (3) death of their parents or guardians and have had an average length of stay in the institution 
of at least 30 days. 


Institutions for delinquent children and youth are public or private residential facilities, other than a foster 
home, that operates primarily for the care of children and youth who have been adjudicated delinquent or 


in need of supervision and have had an average length of stay in the institution of at least 30 days. 


These data will be included in federal accountability as required by federal law. 
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4. MAP-A 
Standards Applicable: 1 and 2 


Updated policy: Previously, the APR calculation utilized a 1% cap on the number of MAP-A proficient or 
advanced scores that were used in accountability determinations for Standard 1 Academic Achievement and 
Standard 2 Subgroup Achievement. The implementation of the ESSA requirement to assess no more than 
1% of students on the alternate assessment did not create a statistically significant change in achievement 
data at the state level, but may have an impact at the district, charter school or school level. 


In an effort to ensure comparability for status and progress, students who have consistently taken the MAP- 
A or who have never taken the MAP-A will be used for the calculation of standards 1 and 2 for state 
accountability purposes. 


These data will be included in federal accountability as required by federal law. 


5. Project Lead The Way (PLTW) 
Standards Applicable: 3*4 


PLTW redesigned program assessments used by the program to assess content knowledge more deeply and 
includes transportable skills valued by industry. As a result, PLTW has developed a new scale score, 
achievement levels and a conversion table to crosswalk the scoring on the prior version of the assessment. 
DESE has used the conversion table to crosswalk the new assessment to the scale for PLTW included in 
Appendix B. 


6. Reporting Changes 
Standards Applicable: All 


The MSIP 5 policy goals include the following: 
e = Articulate the State’s Expectations 
e Distinguish the Performance of Schools and Districts 
e Empower all Stakeholders 
e Promote Continuous Improvement and Innovation 


In order to bring the focus back to distinguishing the performance of schools and districts, several 
modifications are being made to the summary and supporting data pages for the 2019 APR. 


Building level APRs will be generated in 2019 and will display in the same fashion mentioned above. 
Samples reports are included in Appendix H. 


The 2019 APR summary pages will not include the calculation of points or the percentage of points earned, 
but will include data visualizations of the districts growth, progress and status as compared to state level 
data. 
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Overview 


DESE’s strategic plan holds as a primary goal that all Missouri students will graduate ready for success. To measure 
progress toward this goal and to distinguish among school and district performance, DESE generates an Annual 
Performance Report (APR) for each district or charter school. The APR is comprised of MSIP 5 Performance 
Standards, (1) Academic Achievement (2) Subgroup Achievement (3) High School Readiness (K-8 districts) or 
College and Career Readiness (K-12 districts), (4) Attendance Rate and (5) Graduation Rate (K-12 districts). 
Status, progress, and growth (where applicable) are reported. 


Data for academic achievement in ELA and MA, subgroup achievement in ELA and MA (both include status and 
growth), English language attainment, attendance rate and graduation rate are also used for federal accountability 
determinations, including comprehensive and targeted school identification for districts and schools. Visit the ESSA- 
Federal Accountability page for information specific to federal school identification under ESSA. 


The MSIP 5 Performance Standards were approved by the State Board of Education in December of 2011 and went 
into effect in 2013. 


There is often confusion around the terms “school,” “building,” “district” or “LEA.” For the purposes of this manual, 
the labels “school” and “building” are interchangeable, considered an attendance center, have a building code, and 
generate a building-level APR. Similarly, the words “district,” “LEA” and “charter” are interchangeable, have a 
county-district code and generate a district level APR. 
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Performance Standards for K-12 Districts 


1. Academic Achievement—The district administers assessments required by the MAP to measure academic 
achievement and demonstrates improvement in the performance of its students over time. 


a. Student performance on assessments required by the MAP meets or exceeds the state standard or 
demonstrates improvement in performance over time. 


b. The percent of students tested on each required MAP assessment meets or exceeds the state standard. 
c. Growth data indicate that students meet or exceed growth expectations. 


2. Subgroup Achievement—The district demonstrates required improvement in student performance for its 
subgroups. 


a. The performance of students identified on each assessment in identified subgroups, including 
free/reduced lunch (FRL), racial/ethnic background, English language learners, and students with 
disabilities, meets or exceeds the state standard or demonstrates required improvement. 


3. College and Career Readiness—The district provides adequate post-secondary preparation for all students. 


a. The percent of graduates who scored at or above the state standard on any department-approved 
measure(s) of college and career readiness, for example, the ACT®, SAT®, COMPASS® or Armed Services 
Vocational Aptitude Battery (ASVAB), meets or exceeds the state standard or demonstrates required 
improvement. 


b. The district’s average composite score(s) on any department-approved measure(s) of college and 
career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meet(s) or exceed(s) the state 
standard or demonstrate(s) required improvement. 


c. The percent of graduates who participated in any department-approved measure(s) of college and 
career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meets or exceeds the state 
standard or demonstrates required improvement. 


d. The percent of graduates who earned a qualifying score or grade on an Advanced Placement (AP), 
International Baccalaureate (IB), or Technical Skills Attainment (TSA) assessments and/or receive 
college credit or a qualifying grade through early college, dual enrollment, or approved dual credit 
courses meets or exceeds the state standard or demonstrates required improvement. 


e. The percent of graduates who attend post-secondary education/training or are in the military within 
six months of graduating meets the state standard or demonstrates required improvement. 


f. The percent of graduates who complete career education programs approved by DESE and are placed 
in occupations directly related to their training, continue their education, or are in the military within 
six months of graduating meets the state standard or demonstrates required improvement. 


4. Attendance Rate—The district ensures all students regularly attend school. 


a. The percent of students who regularly attend school meets or exceeds the state standard or 
demonstrates required improvement. 
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5. Graduation Rate—The district ensures all students successfully complete high school. 


a. The percent of students who complete an educational program that meets the graduation requirements 
as established by the board meets or exceeds the state standard or demonstrates required 
improvement. 
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Performance Standards for K-8 Districts 
1. Academic Achievement—The district administers assessments required by the MAP to measure academic 
achievement and demonstrates improvement in the performance of its students over time. 


a. Student performance on assessments required by the MAP meets or exceeds the state standard or 
demonstrates improvement in performance over time. 


b. The percent of students tested on each required MAP assessment meets or exceeds the state standard. 
c. Growth data indicate that students meet or exceed growth expectations. 


2. Subgroup Achievement—The district demonstrates required improvement in student performance for its 
subgroups. 


a. The performance of students identified on each assessment in identified subgroups, including FRL, 
racial/ethnic background, English language learners, and students with disabilities, meets or exceeds 
the state standard or demonstrates required improvement. 

3. High School Readiness—The district provides adequate post-elementary preparation for all students. 

a. The percent of students who earn a proficient score on one or more of the high school EOC assessments 
while in elementary school meets or exceeds the state standard or demonstrates required 
improvement. 


4. Attendance Rate—The district ensures all students regularly attend school. 


a. The percent of students who regularly attend school meets or exceeds the state standard or 
demonstrates required improvement. 
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MSIP 5 APR Scoring Guide 


DESE’s Strategic Plan holds as a primary goal that all Missouri students will graduate ready for success. To measure 
progress toward this goal and to distinguish among school and district performance, DESE generates an APR score 
for each district. This overall score is comprised of the MSIP 5 Performance Standards (1) Academic Achievement, 
(2) Subgroup Achievement, (3) High School Readiness (K-8 districts) or College and Career Readiness (K-12 
districts), (4) Attendance Rate and (5) Graduation Rate (K-12 districts). Three distinct metrics focusing on status, 
progress, and growth (where applicable) are used. 


The detailed scoring guides for each performance standard are outlined in this section. The academic and subgroup 
achievement measures are based on the MAP grade-level assessments (GLA), End-of-Course (EOC) assessments, and 
Missouri Assessment Program-Alternate (MAP-A) assessments. The high school readiness measure is based on the 
EOC assessments. Performance and achievement targets will be reviewed and revised, if necessary, when new 
assessments are introduced and/or every three years. 


Due to administration of the Social Studies (SS) field test, there will be no data calculated for SS in 2019. 
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MSIP 5 Performance Standard 1: Academic Achievement 


Academic Achievement — The district administers assessments required by the MAP to measure academic 
achievement and demonstrates improvement in the performance of its students over time. 


1. Student performance on assessments required by the MAP meets or exceeds the state standard or 
demonstrates improvement in performance over time. 

2. The percent of students tested on each required MAP assessment meets or exceeds the state standard. 

3. Growth data indicate that students meet or exceed growth expectations. 


Data are obtained from contracted testing publishers for the grade-level assessment, EOC assessments and 
MAP-A assessments. 
2019 will not have Social Studies data due to field test assessments. If a school district or charter school 


requests a calculation the denominator will be reduced by 10 points. 
All MAP performance data are reported to the nearest tenth. 
Appeal and data correction procedures are in the appendices. 


Growth Measures 

Growth is the change in achievement scores for an individual student between two or more points in time. While 
Progress measures the change in the performance of a defined group over time, Growth measures the achievement 
gains of individual students over time. 


Growth measures for MSIP 5 are determined by conducting a statistical analysis of all valid MAP score pairs from the 
prior three years. A valid MAP score pair is a score from grades 4 through 8 with a score from the prior year and 
grade level. For example, a 4" grade score with a valid 3™ grade score from the prior year, both for the same student, 
is a valid MAP score pair. In this case, the 4 grade score in the pair is the outcome score and the 3" grade score 
from the prior year is the predictor score. A 5tt grade MAP score with no 4" grade score from the prior year would 
NOT be included in the statistical analysis because there is no valid predictor score to go with the outcome score. 


The statistical analyses determine the relationship between outcome scores and predictor scores across all districts 
and schools. This relationship is used to calculate a “predicted outcome score” for each score pair. The differences 
between the predicted outcome scores and the observed outcome scores (the “residuals”) from all the analyzed 
score pairs are then analyzed to determine each district or school “effect” on student achievement growth. 


A score pair is assigned to a district and school when the MAP test that generated the outcome score was taken in 
that district and school, regardless of the district and school where the exam that generated the valid predictor score 
was taken. A district or school growth measure (an “effect estimate”) is the average of the differences between 
observed and predicted scores from all test pairs assigned to the district or school. 


At this time, growth measures are only available for grades 4 through 8 in ELA and MA. District and school growth 
measures are reported in NCE units on the APR. The state mean is, by construction, a score of 50 NCEs. District and 
school growth measures are compared to the state mean and those that are statistically different from the state 
mean will be noted. Statistical significance depends on three factors; the magnitude of the difference from the state 
mean, the number of score pairs analyzed for the district or school, and the overall variability in the individual 
student growth measures. 


Growth is divided into three levels as follows: 


e Exceeding — The district or school growth measure (effect) is greater than 50 AND the difference from 50 
is statistically significant. 

e = On Track — The district or school growth measure (effect) is not statistically different from 50. 

e Floor — The district or school growth measure (effect) is less than 50 AND the difference from 50 is 
statistically significant. 
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Standard 1: Academic Achievement Growth Targets 


Growth Targets in ELA 


not statistically 
significant growth 
estimates 


a statistically 
significant score < 50 


a Statistically significant 
score >50 


Growth Targets in Math 


not statistically 
significant growth 
estimates 


a statistically 
significant score < 50 


a Statistically significant 
score >50 


Status Measures 

Status is a measurement of the district’s or school’s level of achievement based upon a three-year average of the 
MAP Performance Index (MPI), unless three years of data are not available. When three years of data are not 
available for the district and/or school, (e.g., a new school is established) less than three years will be used for 
reporting purposes. When three consecutive years of data are not available for the district and/or school, (e.g. 
participation rate not met in prior year), the three most recent years of data - not to exceed a time span of five years 
- will be used for accountability purposes. A detailed description of how to calculate the MPI can be found later in 
this document. The MPI is used to determine whether the district, school, or subgroup is meeting the target, is on 
track, is approaching, or is substantially not meeting (floor) the academic achievement target for ELA, MA, science, 
and social studies MAP assessments. See the subsection on cell size for further considerations. 


Status is divided into four levels as follows: 


e Target — represents a level of performance approximately equivalent to the projected performance of the 
top 10 states on the corresponding National Assessment of Educational Progress (NAEP) exam OR, in 
subjects for which state-by-state NAEP data are unavailable, an equally rigorous target. 

e On Track — represents levels of increasing performance expectations with a goal of 75 percent proficient 
by the year 2020 - if Basic achievement is worth 300 points and Proficient achievement is worth 400 points, 
an MPI of 375 would result from 75 percent of students scoring at Proficient and 25 percent scoring at 
Basic. Current performance is compared to this target, and then a linear trajectory is created that requires 
equal annual progress increments to reach the target. Targets for ELA and Math were adjusted for the new 
assessment in 2018. 

e Approaching — represents a level of performance equal to 100 percent Basic if each score at the Basic level 
yields 300 points. Targets for ELA and Math were adjusted for the new assessment in 2018. 

e Floor — represents a level of performance less than 100 percent Basic if each score at the Basic level yields 
300 points. Targets for ELA and Math were adjusted for the new assessment in 2018. 


Standard 1: Academic Achievement Status Targets 


Status Targets in ELA 


100.0 - 251.4 251.5 - 348.8 348.9 - 382.0 382.1 - 500 
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Status Targets in MA 


100.0 - 235.8 235.9 - 320.9 321.0 - 377.9 378.0 - 500 


Status Targets in Science 


100.0 - 299.9 300.0 - 347.6 


347.7 - 352.7 352.8 - 500 


Status Targets in Social Studies -2019 Social Studies Field Test No Data 


Progress Measures 

The MPI is also used to measure annual improvement on the MAP assessments. This indicator holds districts and 
schools accountable for continuous improvement year to year using a rolling average. In ELA, MA and science, the 
Progress calculation measures improvement by comparing two-year averages of data and setting targets based on 
a Normal Curve Equivalent (NCE) Gap (NCE is used to standardize the data from old to new assessments). Year 1 
and 2 are averaged, and years 2 and 3 are averaged; the averages are then compared to determine the amount of 
improvement achieved. When three years of data are not available in the district or school, (e.g.,a new school is 
established) less than three years will be used for reporting purposes. When three consecutive years of data are not 
available, (e.g., assessment data are not available one year for a content area), the three most recent years of data - 
not to exceed a time span of five years - will be used for accountability purposes. Progress in the district or school’s 
NCE recognizes movement of students throughout all MAP achievement levels, ensuring that the focus remains on 
all students and not just those closest to being proficient. Differentiated improvement targets are set for districts, 
schools, and subgroups based on the individual group’s two prior years’ achievement. A detailed description of how 
to calculate the MPI Gap and NCE Gap can be found later in this document. 


Progress is divided into four levels as follows: 


e Exceeding — represents equal to or greater than five percent improvement based on the MPI or NCEGap. 

e On Track — represents equal to or greater than three percent but less than five percent improvement 
based on the MPI or NCE Gap. 

e Approaching — represents equal to or greater than 1 percent but less than three percent improvement 
based on the MPI or NCE Gap. 

e Floor — represents less than one percent improvement based on the MPI or NCE Gap. 


Standard 1: Academic Achievement Progress Targets 


Progress Targets in ELA 


10) 0 0, 
<1 % of NCE Gap 1 % of NCE Gap 3 % of NCE Gap 5% of NCE Gap increase 
increase increase increase 


Progress Targets in MA 


0, 0, 0, 
<1 % of NCE Gap 1 % of NCE Gap 3 % of NCE Gap 5% of NCE Gap increase 
increase increase increase 
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Progress Targets in Science 


0 10) 
= “s OE NEE CED : no NEED 3% of NCE Gap increase} 5% of NCE Gap increase 
increase increase 


Progress Targets in Social Studies -2019 Social Studies Field Test No Data 


Test Participation and LND 
All districts and schools are required to assess at least 95 percent of their students and subgroups on the 
assessments required by the MAP. 


District test coordinators are cautioned to pay careful attention to small sizes in certain tested populations. It is 
easier to exceed five percent LND in science (only tested in fifth, eighth, and high school EOC) than in ELA or MA. 
Social studies, with only the high school EOC, is also susceptible to LND issues. Standard 2 Subgroup Achievement is 
normally a smaller group as well and therefor also more susceptible to LND issues. 


LND is applied at the school and district level where appropriate. It is possible to exceed LND in an individual school 
but not at the district level. In addition, for ESSA accountability, LND applies to each individual subgroup. 


English Learners (EL) Exclusion 

To meet the participation standard, ELs in their first year of U.S. schooling must participate in the state English 
Language Proficiency (ELP) assessment instead of ELA assessment (grade level, EOC, MAP-A). However, ELs in their 
first year do participate in appropriate math, science, and social studies assessments. ELs in their second year of U.S. 
schooling and beyond must participate in the appropriate MA, ELA, science, and social studies assessment and the 
state ELP assessment. Exceptions to the ELP assessment requirement will be made only where accommodations for 
ELs with disabilities are not available for a particular test. 


MAP-A Exclusion 

Some students with the most severe cognitive disabilities are not able to take the standard grade-level or EOC 
content area assessment. If the student’s Individualized Education Plan (IEP) team determines the student meets the 
eligibility criteria for the MAP-A, the student takes a MAP-A assessment. Districts are required to assess all students 
who qualify for the MAP-A assessment on the corresponding MAP-A test. A student’s scorable MAP-A assessment in 
grade 11 MA is used to meet the Algebra I EOC participation requirement, the ELA grade 11 is used to meet the 
English II EOC participation requirement, the grade 11 science is used to meet the biology participation 
requirement. The district must use the MAP-A Exception code for the American government EOC assessment. 
However, a student would need to have consistently participated in MAP-A assessments previously before the MAP- 
A Exception code may be used by the district for this assessment. 


If the student’s IEP team determines the student meets the eligibility criteria for the MAP-A, the district is required 
to assess the student using a MAP-A assessment when available. The Every Student Succeeds Act (ESSA) limits the 
number of students who are assessed using alternate assessments. For Missouri, this means that not more than one 
percent of students can be assessed using the MAP-A. 


The one percent cap is calculated at the district level and uses the tested population per subject area. In districts 
which exceed the one percent cap in a content area, an LND will replace the score achieved on the MAP-A 
assessment for each student in excess of one percent. The highest MAP-A scores will be converted to LND until the 
district is down to one percent MAP-A. 


Districts which exceed the one percent cap will be notified by DESE at the end of the assessment year and will be 
required to submit a justification form (provided by DESE) documenting why the district exceeded the MAP-A 
participation limit. 
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Students in Selected Residential Facilities 

Pursuant to section 167.128, RSMo, DESE is prohibited from aggregating the data of students who reside in an 
institution for neglected or delinquent children, a court-ordered group home, an institution for neglected children or 
an institution for delinquent children for purposes of Missouri School Improvement Program (MSIP). This provision 
of law became effective August 28, 2018 and will be implemented for the first time in the 2019 APR. 


Students who have been reported as neglected or delinquent by school districts or charter schools will be removed 
from all standards in the APR. These data will be aggregated into a single APR as required by state law. 


An institution for neglected children and youth is a public or private residential facility, other than a foster home, that 
is operated primarily for the care of children and youth who have been committed to the institution or voluntarily 
placed in the institution under applicable State law due to (1) abandonment; (2) neglect; or (3) death of their 
parents or guardians and have had an average length of stay in the institution of at least 30 days. 


An institution for delinquent children and youth is, as determined by the State Education Agency, a public or private 
residential facility, other than a foster home, that is operated primarily for the care of children and youth who have 
been adjudicated delinquent or in need of supervision and have had an average length of stay in the institution of at 
least 30 days. 


These data will be included in Missouri’s federal accountability data as required by federal law. 


Full Academic Year (FAY) 

Districts are required to test all enrolled students, unless the above specified EL or MAP-A Exclusion applies. All 
scores will be reported (included in the participation rate), but only scores of those students who have been 
enrolled a “Full Academic Year” (FAY) in a district and/or school will be included in the calculation of the APR data. 
A FAY is defined as any student who is enrolled from the last Wednesday in September through the MAP 
administration, without transferring out of the district or school for a significant period of time and re-enrolling. A 
significant period of time is considered “one day more than half of the eligible days between the last Wednesday in 
September and the test administration”. This information is obtained from the Missouri Student Information System 
(MOSIS) data reported by districts in the April submission. This applies to each summary level independently. For 
example, a student who is coded as “in building less than a year” but was in the district a full academic year is 
excluded from the school totals but is included in the district totals. 


Participation Rate Calculation 

The participation rate calculates the percent of students who receive a valid MAP score in a subject or content area. 
All enrolled students are considered “accountable” students (Exception: for ELA only, recently arrived or in U.S. less 
than a year are excluded from the ELA assessment). An accountable student who receives a valid MAP score ina 
subject or content area is defined as a “participant”. The number of participants divided by the number of 
accountable students is the participation rate (used to determine percent LND). When an accountable student does 
not receive a valid test score, the student receives an LND in place of an achievement level score. The percent for 
LND may not exceed five percent, as all districts and schools are required to assess at least 95 percent of their 
students and subgroups on the assessments required by the MAP. 


Step 1 - The number of Accountable students is determined. 


- Accountable 
Participants LND Students Students 
130 + 2 132 


Step 2 - The Participation Rate is determined. Participants divided by accountable students = “Participation Rate” 
rounded to the tenth. 


Participants Accountable Students Participation Rate 


130 / 132 98.5% 
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Definitions 


All students enrolled during the testing window. 
Accountable Excludes in U.S. less than a year (recently arrived) students from ELA only. 
Note: MAP scores are comprised from grade-level, MAP-A*, and EOC assessments. 


Participant A student who receives a valid MAP score/achievement level. 


Participant students minus students in building (district) less than a full academic 
Reportable year (FAY) (participants - less than FAY). These student scores contribute to the 
calculation of the APR data. 


Number of students without an achievement level or an attempt on any session on 
the test. 
Note: Graduating seniors that have not participated in all required EOC assessments 
or appropriate MAP-A* will receive the applicable LND. 

*MAP-A students with a scorable MAP-A assessment in a tested grade level are assigned an Achievement Level. 


LND 


Cell Size 

Districts, schools, and the super subgroup (Standard 2: Subgroup Achievement) must have at least 30 Accountable 
students in the group being measured in a given content area each year over a three year period in order to generate 
scores for accountability based on the average of three annually-calculated MPIs. If this is not possible, the Status 
measure is calculated by “pooling” three years of data and summing the number of accountable students and the 
numbers of students in each achievement level across the three-year period; the “pooled” count is used in the 
calculation for determining Status and is referred to as the cumulative measure. 


This flowchart explains the conditions triggering special cell size decisions for Standard 1: Academic Achievement 
and Standard 2: Subgroup Achievement. 


Cell Size 


Is the cell size greater Calculate Status using three-year 
than 30 in each of the average MPI and calculate Progress 
three years available? with available three years of data 


Is the cell size greater Calculate Status using three year 
than 30 cumulative in cumulative (pooled) MPI and calculate 
all three years Progress with available three years of 


available? data 


Standard 1: Academic Achievement 
Calculate Status using three year cumulative 
(pooled) MPI and calculate Progress with 
available three years of data 
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Measuring MAP 

The MAP Performance Index (MPI) is used within the Status and Progress metrics and to set academic 
achievement targets for district, school, and subgroup achievement. Student performance on tests administered 
through the MAP is reported in terms of four achievement levels (Below Basic, Basic, Proficient and Advanced) that 
describe a pathway to proficiency. The MPI is a single composite number that represents the MAP assessment 
performance of every student by awarding points to each student based on the four achievement levels. The points 
for all students in the district, school, or subgroup in a subject area are summed together, divided by the number of 
students in the group being measured and then multiplied by 100 rounded to the tenth. The result is the MPI for that 
group and subject. All assessment results from a single accountability year and for a single subject/content area are 
combined when generating the district, school, or subgroup MPI. 


MPI Point Values 
Numeric values are assigned to each of the achievement level scores as follows: 


Achievement Level Index Point Value 
Below Basic al 
Basic 3 
Proficient 4 
Advanced 5 


Assigning one point to the Below Basic achievement level and three points for the Basic achievement level supports 
Missouri’s expectation of placing each child on a path toward Proficiency. The additional point spread is designed to 
recognize, through year-to-year improvement in the MPI, the movement of students from this least desirable 
achievement level. The use of the index also allows for distinction between the Proficient and Advanced student, 
holding districts and schools accountable for continuous improvement beyond proficiency. 


MPI Example Calculation 

Achievement levels are provided by the testing companies for the total number of Reportable Students in each 
subject area. In the following example of a single content area for a grade 6 through 8 school, achievement levels 
generated through the grade-level MAP, the MAP-A, and the EOC assessments may be utilized. To generate the MPI, 
the number of Advanced scores are multiplied by five, Proficient scores by four, Basic scores by three, and Below 
Basic scores by one. These products are then summed, divided by the total number of reportable and multiplied by 
100 then rounded to the tenth to produce the MPI that ranges from 100-500. The following example shows how the 
index is calculated in a single subject and school: 


Step 1 - The number of students in each achievement level is determined for each year. 


Number Reportable Total 
Grade6 Grade7 Grade8 EOC MAP-A Reportable 
Below Basic 10 5 5 0 7 20 
Basic 10 10 15 0 - 35 
Proficient 5 10 15 9 1 = 40 
Advanced 15 8 5 2 = 30 
Total Reportable = 125 


Step 2 - The index point value assigned to each achievement level is multiplied by the number of students in each 
achievement level. 


Achievement Level Index Point Value # of Students Index Points 
Below Basic 1 ii 20 = 20 
Basic 3 = 35 - 105 
Proficient 4 = 40 = 160 
Advanced 5 wi 30 = 150 
Total 125 435 
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Step 3 - The total index points is divided by the total number of reportable students and multiplied by 100 rounded 
to the tenth. 


Total Index Points Reportable MPI 
Students 
435 / 125 = 3.48 * 100 348 
The same method is used when calculating at the district level. 
Step 1 - The number of students in each achievement level is determined for each year. 
Total 
Gr3 Gr4 Gr5 Gr6 Gr7 Gr8 EOC MAP-A 
Reportable 
Below Basic 5 8 7 10 5 5 5 = 45 
Basic 12 10 8 10 10 15 15 = 80 
Proficient 17 20 14 5 10 25 25 2 = 118 
Advanced 10 11 10 15 10 5 15 1 = 77 
Total Reportable 320 


Step 2 - The index point value assigned to each achievement level is multiplied by the number of students in each 
achievement level. 


Achievement Level Index Point Value # of Students Index Points 
Below Basic 1 7 45 - 45 
Basic 3 * 80 = 240 
Proficient 4 * 118 = 472 
Advanced 5 = 77 - 385 
Total 320 1,142 


Step 3 - The total index points is divided by the total number of Reportable Students and multiplied by 100 rounded 
to the tenth. 


Total Index Points Reportable MPI 
Students 
1,142 if 320 = 3.569 * 100 356.9 


Status Measure Calculation 

The MPI is used to determine whether the district, school, or subgroup is meeting the target, is on track to meeting 
the target, is approaching or is substantially not meeting (floor) the academic achievement targets set for the MAP 
content area. Using three years of data, this indicator holds districts and schools accountable for student 
performance in relation to statewide academic achievement targets. 


Example: Using three years of data to calculate the three year MPI for “ABC” district population for MA. 


Year 1 Year 2 Year 3 3-year MPI 
MPI MPI (most recent year) MPI Status 
354.2 + 356.9 + 360.1 = 1,071.2 /3 357.1 


In this example, the MPI for MA from Year 1, Year 2, and Year 3 are averaged and the mean is used to determine 
whether the district, school or subgroup is meeting or exceeding the target, is on track to meeting the target, and is 
approaching or is substantially not meeting (floor) the academic achievement target. 
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Progress Measure Calculation 

Beginning in 2016, the MPI and NCE will be used to measure annual improvement for ELA and MA assessments. This 
indicator holds districts and schools accountable for continuous improvement in the district, school, or super 
subgroup year to year using a rolling average. It recognizes movement of scores throughout all MAP achievement 
levels, ensuring that the focus remains on all students and not just those closest to being proficient. Differentiated 
improvement targets are set for districts, schools, and super subgroups based on the individual group’s two prior 
years of achievement. Beginning in 2019, the MPI and NCE will also be used this way for Science. Due to the 
adoption of the Missouri Learning Standards and new assessments in ELA, MA, and Science assessments, the MPI 
totals within these contents are converted to an NCE and subtracted from a constant set at a 130 NCE to determine 
the NCE Gap. 


Example: Calculating the progress measure for “ABC” school district based on a rolling average of NCE and MPI, the 
following example shows how the progress measure is calculated at the district level: 


ABC district: ELA Year 1 Year 2 ce 
(most recent year) 
NCE 51.4 54.8 44.8 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
ELA (NCE): (51.4 + 54.8) /2 =53.1 


Step 2 - The average NCE/MPI for Years 1 and 2 is subtracted from the constant to determine the NCE/MPI Gap. 


Constant Years 1 and 2 Average Gap 
ELA (NCE): 130 - 53.1 = 76.9 


Step 3 - The NCE Gap is used to establish Progress Targets as determined by multiplying the NCE Gap by the 
associated percentage, e.g. five percent for exceeding, three percent for on track, one percent for approaching. 


Table 1. Generating Targets for Progress Measure 


ELA (NCE) 
NEE Years 1 and 2 Years 2 and 3 Average 
NCE GaP Mickesse Average NCE Progress Target 
Needed 8 8 8 
Exceeding 76.9 * 5% = 3.8 53.1 56.9+ 
On Track 76.9 . 3% = Jace 53.1 55.4-56.8 
Approaching 76.9 7 1% = 0.8 53.1 53.9-55.3 
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Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 
ELA (NCE): (54.8 + 44.8) / 2 = 49.8 


Step 5 - Subtract the Years 1 and 2 (prior two-year) average from the Years 2 and 3 (current two-year) average to 
determine the minimum increase needed to meet each target level. 


ELA (NCE): 49.8 - 53.1 = -3.3 


Step 6 - The district’s Years 2 and 3 average is compared to the district’s Years 1 and 2 average to determine if the 
district is exceeding, on track, or approaching the required increase. In the ELA (NCE) example, the ABC school 
district has a Year 2 and 3 average NCE of 49.8, a decrease of 3.3 NCE from the Year 1 and 2 average NCE, which 
means that it is designated as “Floor” with the improvement benchmark. In the Science (MPI) example, the ABC 
school district has a Year 2 and 3 average MPI of 356.0, an improvement of 3.6 MPI from the Year 1 and 2 average 
MPI, which means that it is designated as “On Track” with the improvement benchmark. 


Growth Measure Calculation 

Growth measures in ELA and MA grades 4 through 8 are calculated using a Missouri Growth Model and included as a 
Growth Score that may be used in place of the district, school, or super subgroup Progress Score. Using statistical 
methods, the Missouri Growth Model estimates the systemic contributions of districts and schools on student 
growth. For a full description, see Missouri Growth Model in Appendix G. 
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MSIP 5 Performance Standard 2: Subgroup Achievement 


Subgroup Achievement — The district demonstrates required improvement in student performance for its 
subgroups. 


1. The performance of students identified on each assessment in identified subgroups, including FRL, 
racial/ethnic background, English language learners, and students with disabilities, meets or exceeds the 
state standard or demonstrates required improvement. 


Data are obtained from contracted testing publishers for the grade-level assessment, EOC assessments, and 
MAP-A assessments. 

Individual subgroups with 10 or more will be displayed as a report only item. 

The n-size for accountability purposes remains at 30. 


The 2019 APR data will not have Social Studies data due to field test assessments. 

All MAP performance data are reported to the nearest tenth. 

Standard 2: Subgroup Achievement calculates the percent proficient or advanced and the MAP Performance 
Index (MPI) by subject area for students who are included in the super subgroup. 

Individual subgroup data are available in the Missouri Comprehensive Data System Portal (MCDS). 


Super Subgroup 

To better differentiate among needs of the districts or schools and to ensure broader inclusion of students whose 
subgroups have historically performed below the state total, Missouri will continue to issue and report academic 
achievement for students in the aggregate and for low income students, students with disabilities, English learners, 
and the state’s major racial and ethnic subgroups. A review of Missouri data identifies five significant gaps in 
subgroup performance (Black, Hispanic, low income students, students with disabilities and English learners). For 
state accountability determinations (e.g. district accreditation), a super subgroup comprised of these five subgroups 
is used. A student who is included in one or more of the five identified subgroups is included as a single count in the 
super subgroup calculation. 


In the example below, all ten students’ scores are included in Standard 1: Academic Achievement in the group of 
total for accountability and reporting purposes when the cell size requirement is met (see cell size description for 
actual cell size requirements of 30). 


For Standard 2: Subgroup Achievement, a student who is included in one or more of the five identified subgroups, 
such as students B, C, D, E and G, are only included once (unduplicated count) in the super subgroup calculation 
when the cell size requirement is met. 


Asian/ Am é Multi - 
Student | Total Pacis indian White Racial 
A X xX 
X xX 
xX 
xX 
xX 
F xX xX 
X xX 
H X xX 
I X xX 
l x as 


Performance of individual subgroups is reported for planning purposes. For example, Student B’s score would be 
reported in the group of Total, White, FRL, and IEP. 
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Cell Size 

Districts, schools, and the super subgroup (Standard 2: Subgroup Achievement) must have at least 30 Accountable 
students in the group being measured in a given content area each year over a three year period to calculate the 
three-year average MPIs. If this is not possible, the Status measure is calculated by “pooling” three years of data and 
summing the number of Accountable students and the numbers of students in each achievement level across the 
three-year period; the “pooled” count is used in the calculation for determining Status and is referred to as the 
cumulative measure. 


This flowchart explains the conditions triggering special cell size decisions for Standard 1 and 2: 


Cell Size 


Is the cell size greater Calculate Status using three-year 
than 30 in each of the average MPI and calculate Progress 
three years available? with available three years of data 


Is the cell size greater Calculate Status using three-year 

than 30 cumulative in cumulative (pooled) MPI and calculate 
all three years Progress with available three years of 
ayailable? data 


Standard 1: Academic Achievement 
Calculate Status using three year cumulative (pooled) MPI and 
calculate Progress with available three years of data 


Status, Progress and Growth Measures 

The super subgroup measures for Status, Progress, and Growth are calculated through the same methodology used 
to compute the district or school-level Standard 1: Academic Achievement. This includes measures of MPI 
calculations for status; NCE calculations for ELA, MA, and Science; test participation; MAP-A exclusions; EL 
exclusions; and full academic year. 


The Status targets for Standard 2: Subgroup Achievement are established based on cutting the achievement gap in 
half. 


Standard 2: Subgroup Achievement Status Targets 


Status Targets in ELA 


100.0 - 251.4 251.5 - 315.9 316.0 - 382.0 382.1 - 500 


Status Targets in MA 


100.0 - 235.8 235.9 - 282.4 282.5 - 377.9 378.0 - 500 
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Status Targets Science 


100.0 - 299.9 300.0 - 322.6 322.7 - 352.7 352.8 - 500 


Status Targets for Social Studies -2019 Social Studies Field Test No Data 


Standard 2: Subgroup Academic Achievement Progress Targets 


Progress Targets in ELA 


0, 1) 1) 
<1 % of NCE Gap 1 % of NCE Gap 3 % of NCE Gap 5% of NCE Gap increase 
increase increase increase 


Progress Targets in MA 


10) 1) 1) 
<1 % of NCE Gap 1 % of NCE Gap 3 % of NCE Gap 5% of NCE Gap increase 
increase increase increase 


Progress Targets in Science 


1) 0, 
= o eo NEE Gap . ft New GaP 3% of NCE Gap increase} 5% of NCE Gap increase 
increase increase 


Progress Targets in Social Studies -2019 Social Studies Field Test No Data 


The same conceptual and statistical framework used to generate growth measures for Academic Achievement 
applies to the growth estimates generated for Subgroup Achievement. However, since the Growth Measure for 
Subgroup Achievement compares the average Growth of students in a district or school’s super subgroup to that of 
the state non-super subgroup, Growth Measures for Subgroup Achievement must be interpreted in a different 
manner. 


Subgroup growth measures are reported in NCE units on the APR. Growth measures that are statistically different 
from the state average growth of the non-super subgroup will be noted. 


Growth is divided into three levels as follows: 


e Exceeding — The district or school growth measure (effect) is greater than 50 AND the difference from 50 
is statistically significant. 

e = On Track — The district or school growth measure (effect) is not statistically different from 50. 

e Floor — The district or school growth measure (effect) is less than 50 AND the difference from 50 is 
statistically significant. 


Growth Targets in ELA 


not statistically 
significant growth 
estimates 


a statistically significant 
score >50 


a statistically 
significant score < 50 
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Growth Targets in Math 


not statistically 
significant growth 
estimates 


a statistically 
significant score < 50 


a statistically significant 
score >50 
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MSIP 5 Performance Standard 3: Indicators 1-3 
College and Career Readiness (CCR) (K-12 districts only) 


College and Career Readiness (K-12 districts) — The district provides adequate post-secondary preparation 
for all students. 


1. The percent of graduates who scored at or above the state standard on any department-approved 
measure(s) of college and career readiness, for example, the ACT®, SAT®, COMPASS®, or Armed Services 
Vocational Aptitude Battery (ASVAB), meets or exceeds the state standard or demonstrates required 
improvement. 

2. The district’s average composite score(s) on any department-approved measure(s) of college and career 
readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meet(s) or exceed(s) the state standard or 
demonstrate(s) required improvement. 

3. The percent of graduates who participated in any department-approved measure(s) of college and career 
readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meets or exceeds the state standard or 
demonstrates required improvement. 


Data are obtained from the MOSIS June Enrollment and Attendance file and from official testing 
companies (ACT®, SAT®, COMPASS®, ACCUPLACER® and WorkKeys®) for scores on department- 
approved measures of college and career readiness. 

ASVAB data are reported by the district through MOSIS submission. 

When students take multiple types of tests and/or a single test multiple times, the highest score is used 


for the APR calculation. 

ACT®, SAT®, COMPASS®, ACCUPLACER®, WorkKeys®, and ASVAB weighted scores are available in 
Appendix A - “CCR*1-3 Assessment Scores Matrix”. 

Students coded both GO3 & MAP-A will be excluded from 3*1-3. Districts must identify MAP-A EOC 
assessment students by using the EOCEX3 exemption code. 


Example of supporting data format for APR 


Year 1 Year 2 tea Status 
a recent) 


From MOSIS Number of graduates 
with a regular diploma 


Number of graduates 
From MOSIS Scoring at or Above the 110.25 
and testing State Standard witha 
company regular diploma 


Percent of graduates 
Scoring at or Above the 
State Standard witha 
regular diploma 


58.8 64.4 71.1 64.8 
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Method for calculating number of students at or above the state standard 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


Approximate equivalent scores are 
used to establish comparability of 
scores on different assessments. A 
matrix of approximately equivalent 
CCR*1-3 assessment scores 

(Appendix A) displays SAT®, 
COMPASS®, WorkKeys®, 
ACCUPLACER® and ASVAB exams 
and their approximately equivalent 
ACT® scores. Scores on the ACT® 
are used as reported. ACT® scores 
and approximately equivalent 
scores derived from other 
assessments must be equal to or 
greater than the ACT® anchor 
score in order to be included in 
the number of students scoring at 
or above the state standard. The 
exam contributing the highest 
approximate equivalent score is 
used for each student. 


Unduplicated Count 


a) number of graduates who 
score at or above a 26 on the 
ACT® or who demonstrate 
comparable performance ona 
department-approved 
measure multiplied by 1.25 


b) number of graduates who 
score at or above a 22 onthe 
ACT® but below a 26 or who 
demonstrate comparable 
performance ona 
department-approved 
measure multiplied by 1 


c) number of graduates who 
score at or above an 18 on the 
ACT® but below 22 or who 
demonstrate comparable 
performance ona 
department-approved 
measure multiplied by 0.75 


d) number of graduates who 
participate in a department 
approved measure of college 
and career readiness but 
score below comparable 
performance of an 18 on the 
ACT® multiplied by 0.25 


e) number of graduates without 
a score multiplied by zero 


a) 18* 1.25 = 22.5 


b) 43 *1=43 


c) 52* 0.75 =39 


d) 23 * 0.25 =5.75 


e) 19*0=0 


Number of graduates scoring at or 
above the state standard 


22.5+43 + 39+5.75+0=110.25 


-Refer to Appendix A for the CCR*1-3 Assessment Scores Matrix 
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Method for calculating status 
The percent of graduates scoring at or above state standard is determined by dividing the number of graduates 
scoring at or above the state standard by the number of graduates, then multiplying by 100 rounded to the tenth. 


Explanations of Data Examples of Data Examples of Calculations 


1) The number of graduates is based on 
June Enrollment and Attendance Records | number of graduates 155 
with an Exit Code indicating the student 
graduated. 


2) The number of graduates scoring at or 
above the state standard is provided by | number of graduates scoring at 
the testing companies supplying approved | or above the state standard 
assessment data; ASVAB data are 
provided by districts through MOSIS. 


110.25 


3) The percent of graduates scoring at or 
above the state standard is determined 
by dividing the number of graduates 
scoring at or above the state standard 
by the number of graduates, then 
multiplying by 100 rounded to the tenth. 


a) number of graduates scoring | a) 110.25 /155=0.711 
at or above the state standard 
=110.25 


b) number of graduates = 155 b) 0.711 * 100 = 71.1% 


4) Status is determined by adding Year 1, 
Year 2, and Year 3 of the percent of 
graduates scoring at or above the state | (Year 1 + Year 2 + Year 3) / 3 
standard, dividing by three (unless three 
years of data are not available) and 
rounding to the tenth. 


58.8 + 64.4 + 71.1 = 194.3 


194.3 / 3 = 64.8% 


Standard 3: College and Career Readiness Status Targets 


Status Targets in Standard 3*1-3 CCR 


0.0 - 39.9% 40.0 - 67.1% 67.2 - 71.4% 71.5 - 100% 


Method for Calculating Progress 
Differentiated improvement targets are set for a given district or school based on the two prior years’ performance 
of that district or school. 


Example: Calculating the Progress measure for “ABC” school district, the following example shows how the Progress 
measure is calculated at the district level using a rolling average: 


ABC district Year 1 Year 2 Lalas 
(most recent year) 
percent of students scoring at or 
above state standard ia ie fas 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
(58.8 + 64.4) /2 = 61.6 


Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the CCR*1-3 Gap. 


Comprehensive Guide to MSIP 5 - 2019 Page 28 


Years 1 and 2 ¥ 
Constant Average % CCR*1-3 Gap 


100 - 61.6 = 38.4 


Step 3 - The CCR*1-3 Gap is used to establish Progress Targets as determined by multiplying the CCR*1-3 Gap by the 
associated percentage, e.g. 25 percent for exceeding, 15 percent for on track, five percent for approaching. 


Table 2. Generating Targets for Progress Measure 


% Increase Years 4 and? Years 2 and 3 
CCR*1-3 Gap Needed Average % ice ae 
Exceeding 38.4 ki 25% = 9.6 61.6 71.2-100 
On Track 38.4 si 15% = 5.8 61.6 67.4-71.0 
Approaching 38.4 - 5% = 1.9 61.6 63.5-67.2 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 
(64.4 + 71.1) /2=678 
Step 5 - The district’s Year 2 and 3 average percentage is used to determine if the district is exceeding, on track, or 


approaching the required percent increase. In the example above, the ABC school district has a Year 2 and 3 average 
percentage of 67.8, which means that it is designated as “On Track” (67.4-71.0 range) with the Progress Target. 


Progress Targets in Standard 3*1-3 CCR 


<5% of CCR*1-3 5% of CCR*1-3 Gap 15% of CCR*1-3 Gap 25% of CCR*1-3 Gap 
Gap increase increase increase increase 
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MSIP 5 Performance Standard 3: Indicator 4 
College and Career Readiness (CCR) (K-12 districts only) 


College and Career Readiness (K-12 districts) — The district provides adequate post-secondary preparation 
for all students. 


4. The percent of graduates who earned a qualifying score on an AP, IB, or IRC assessments and/or receive 
college credit through early college, dual enrollment, or approved dual credit courses meets or exceeds the 
state standard or demonstrates required improvement. 


Data are obtained from the MOSIS June Enrollment and Attendance file, MOSIS June Student Core, October 
Student Assignment, Courses Completed, and Grades Earned, and from official testing companies (AP and 
IB). 

Only dual credit courses from a Missouri institution that is complying with the Coordinating Board for 
Higher Education’s Dual Credit Policy and Principles of Good Practice for Dual Credit Courses will be 
recognized. See Appendix C. 

Test Scores for high school level Project Lead The Way (PLTW) courses are included in the APR. For 
additional information, please see a list of approved PLTW courses. PLTW assessment scale scores of six or 
higher are included in Standard CCR 3*4. Data are obtained from the official testing company. 

PLTW redesigned assessments used to assess content more deeply and include transportable skills valued 
by industry. As a result, PLTW has developed a new scale score, achievement levels and a conversation 
table. DESE has used the conversion table to crosswalk the new assessment to the scale included in 
Appendix B. 

When students take multiple types of tests and/or a single test multiple times or earn multiple credits, one 
metric (the highest) is used for the APR data. 

Dual credit and dual enrollment courses offered within the summer school term are utilized in the 
calculation. The summer school term is considered part of the following academicyear. 

Students coded as both GO3 & MAP-A will be excluded from Standard 3*4. 

Complete listing of approved IRC’s 
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Method for calculating number of students at or above the state standard 


Step 1 - Determine the number of students with a qualifying score on any of the approved options and multiply by 


associated point value. 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


Scores on the AP, IB, or PLTW 
exams are used as reported by the 
testing company. Scores ona 
department-approved IRC are used 
as reported in MOSIS. Grades 
earned in department-approved 
dual credit courses, dual 
enrollment, early college, AP 
courses and IB courses are used as 
reported in MOSIS. The metric 
contributing the highest score is 
used for each student. 


Unduplicated Count 


a) number of graduates who score at 
or above a three on an AP exam or 
who score at or above a four on an 
IB exam multiplied by 1.25 


b) number of graduates who score 
proficient on a department- 
approved IRC assessment or a 
scale score of six or higher ona 
PLTW assessment multiplied by 
one 


c) number of graduates who earn a 
“B” or greater in a department- 
approved dual credit course, dual 
enrollment course, early college 
course, AP course, or IB course 
multiplied by one 


d) number of graduates without a 
qualifying score or grade on an 
approved measure multiplied by 
zero 


a) 16 * 1.25 = 20 


b) 12*1=12 
c)41*1=41 
d) 81*0=0 


Number of graduates scoring at or 
above the state standard 


20+12+41+0=73 


Step 2 - Divide the number of Points Earned by the number of graduates and multiply by 100 rounded to the tenth. 


Total Points Earned 


Number of Graduates 


MPI 


73 / 


150 = 


48.7% 
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Example of supporting data format for APR 


Year 3 


Year 1 Year 2 Status 
(most recent) 
From = 
eit Number of graduates 
scoring at or above 87 97.5 
MOSIS 
; the state standard 
and testing 
company 
% of graduates 
scoring at or above 58.8 63.7 48.7 57.1 


the state standard 


Method for Calculating Status 


Explanations of Data 


Examples of Data 
(using Year 1-Year 3) 


Examples of Calculations 


earned a qualifying score is 
determined by dividing the number 
of graduates who earned a 
qualifying score on the AP, IB, IRC, 
PLTW, or early college, or earned a 
qualifying grade for dual 
enrollment or approved dual 
credit courses or by the number of 
graduates, then multiplying by 100 
rounded to the tenth. 


a) number of graduates = 148 


b) number of graduates scoring at or 
above the state standard = 87 


1) The number of graduates is based 

on June Enrollment and Attendance 

eee amey terra indicating number of graduates 148 (Year 1) 
2) The number of graduates who 

earned a qualifying score on the AP, 

IB, IRC, PLTW, or early college 

assessment, or a qualifying grade in number of graduates who earned a 

dual enrollment or approved dual qualifying score on the AP, IB, IRC, or 

credit course provided by the testing | €rly college assessments and/or 

: ‘ 87 (Year 1) 

companies and/or by the Courses received college credit through dual 

Completed and Grades Earned as enrollment or approved dual credit 

reported in June Enrollment and COUTS> 

Attendance. 
3) The percent of graduates who 


% of graduates scoring at 
or above the state 
standard = 

87 / 148 = 0.588 


0.588 * 100 = 58.8% 
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4) Status is determined by adding Year 
1, Year 2, and Year 3 of the percent of 
graduates who earned a qualifying 
score on the AP, IB, IRC, PLTW, or 


early college assessments, or 58.8 + 63.7 + 48.7 = 171.2 
earned a qualifying grade indual | (Year 1+ Year 2+ Year 3) /3 
enrollment or approved dual 171.2 /3=57.1% 


credit courses, dividing by three 
(unless three years of data are not 
available), and rounding to the tenth. 


Status Targets in Standard 3*4 CCR 


0.0 - 4.9% 5.0 - 43.8% 


43.9 - 47.7% 47.8 - 100% 
Method for Calculating Progress 


Differentiated improvement targets are set for a given district or school based on the two prior years’ performance 
of that district or school. 


Example: Calculating the Progress measure for “ABC” school district, the following example shows how the CCR*4 
Progress measure is calculated at the district level using a rolling average: 


ABC district Year 1 Year 2 ae ee year) 
% of students who earn a qualifying 58.8 63.7 48.7 
score : 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
(58.8 + 63.7) /2 = 61.3 
Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the CCR*4 Gap. 


Constant Years 1 and 2 Average % CCR*4 Gap 


100 - 61.3 = 38.7 


Step 3 - The CCR*4 Gap is used to establish Progress Targets as determined by multiplying the CCR*4 Gap by the 
associated percentage, e.g. 25 percent for exceeding, 15 percent for on track, five percent for approaching. 


Table 3. Generating Targets for Progress Measure 
Years 2 and 3 


% Increase Years 1 and 2 Average 

CCR*4 Gap Needed Average % Progress Target 
Exceeding 38.7 * 25% = 9.7 61.3 71.0-100 
On Track 38.7 i 15% = 5.8 61.3 67.1-70.9 
Approaching 38.7 * 5% = 1.9 61.3 63.2-67.0 
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Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 

(63.7 + 48.7) /2 =56.2 
Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is exceeding, on track, or 
approaching the required percent increase. In this example, the ABC school district has a Year 2 and 3 average 


percentage of 56.2, which means that it is designated at the “Floor” for not meeting the Progress Targets. 


Progress Targets in Standard 3*4 CCR 


<5% of CCR*4 Gap 5% of CCR*4 Gap 15% of CCR*4 Gap 25% of CCR*4 Gap 
Increase Increase Increase Increase 
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MSIP 5 Performance Standard 3: Indicators 5-6 
College and Career Readiness (CCR) (K-12 districts only) 


College and Career Readiness (K-12 districts) — The district provides adequate post-secondary preparation 
for all students. 


5: 


6. 


The percent of graduates who attend post-secondary education/training or are in the military within six (6) 
months of graduating meets the state standard or demonstrates required improvement. 

The percent of graduates who complete career education programs approved by the department and are 
placed in occupations directly related to their training, continue their education, or are in the military with 
in six (6) months of graduating meets the state standard or demonstrates required improvement. 


In accordance with legislation, the definition of placement for graduates who complete approved career 
education programs has been expanded for MSIP purposes. Districts will continue to report “Related” and 
“Not Related” placement for Perkins purposes and DESE will capture both populations for credit. Prior year 
data have been collected by DESE and factor into current year calculations. 

Students coded as both GO3 & MAP-A are INCLUDED in 3*5-6. 

Data are obtained from the MOSIS June Enrollment and Attendance file and February Student Graduate 
Follow-up. 

The total number of graduates in the denominator is the sum of students reported as GO1 and GO3 from the 
previous year. 

The MOSIS February Student Graduate Follow-up submission is compared to the National Student 
Clearinghouse (NSC), post-secondary enrollment records verified by participating institutions. NSC data is 
provided to LEAs in the secured report “Graduates Found in Higher Education (NSC)”on the MCDS Portal. A 
LEA with a 15 percent variance from NSC will receive a warning and a 25 percent variance from NSC will 
receive an error in the MOSIS Student Graduate Follow-Up submission. Adequate supporting 
documentation may be required to certify the file. 

Fax documentation to 573-526-3045 to request approval to bypass the error. An explanation must be given 
in the comments field. Two common reasons for bypassing the error include the post-secondary institution 
does not participate in NSC (district provide the name of institution in comments) or the student had a 
name change since graduation (NSC and MOSIS unable to match records). 

This is a lagged indicator representing graduates from the preceding year(s). 

For placement related questions see the Career Education Placement/Follow-Up Guidelines in the appendix. 
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Example of Supporting Data Format for APR 


Status is determined by adding Year 1, Year 2, and Year 3 of the percent of post-secondary placement and 
dividing by three rounded to the tenth. 


Post-secondary education, training, 
military and CTE placement 


Status 


From 
MOSIS 
June 
Student 
Core and 
Enrollment 


Number of graduates 


Number of graduates who attend post- 
From secondary education or training, are in 
MOSIS the military, or who complete a 
February department-approved Career 
Follow-up Education course and are employed 

within six months of graduating. 


% of post-secondary placement 
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Method for Calculating Supporting Data 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


The percent of post-secondary 
placement is determined by 
dividing the number of graduates 
who attend post-secondary 
education or training, are in the 
military, or who complete a 
department-approved Career 
Education course (0604 does not 
count) and are employed by the 
number of graduates, and then 
multiplying by 100 rounded to the 
tenth. 


Unduplicated Count 


a) number of graduates who 
attend post-secondary 
education = 147 


b) number of graduates who 
attend post-secondary training 
=118 


c) number of graduates who are 
in the military = 17 


d) number of graduates who 
complete a department- 
approved Career Education 
course and are employed = 57 


147+ 118 + 17+ 57= 339 


Number of graduates = 385 


385 


339 / 385 = 0.881 


% of post-secondary placement 


0.881 * 100 = 88.1% 


Method for Calculating Status 


The percent of graduates who earned a qualifying score on post-secondary placement is determined by dividing the 
number of graduates who earned a qualifying score by the number of graduates, then multiplying by 100 and 


rounded to the tenth. 


Explanations of Data 


Examples of Data 


Examples of Calculations 


1) The number of graduates is 


Code indicating the student 
graduated. 


post-secondary education or 


who complete a department- 
approved Career Education 


six months of graduating. 


based on June Enrollment and 
Attendance Records with an Exit 


2) Number of graduates who attend 


training, or are in the military, or 


course and are employed within 


number of graduates 


qualifying score 


number of graduates who earned a 


385 


339 
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3) The percent of graduates who 
earned a qualifying score is 
determined by dividing the 
number of graduates who 
earned a qualifying score in 
post-secondary placement by 
the number of graduates, then 
multiplying by 100 rounded to the 
tenth. 


a) number of graduates = 385 339 / 385 = 0.881 
b) number of graduates who earn a 


* = 0 
qualifying score = 339 GAEL AU) One 


4) Status is determined by adding 
Year 1, Year 2, and Year 3 of the 
percent of graduates who 
earned a qualifying score in 
post-secondary placement, 
dividing by three (unless three 
years of data are not available), 
and rounding to the tenth. 


85.0 + 93.3 + 88.1 = 266.4 
(Year 1 + Year 2 + Year 3) /3 
266.4 / 3 = 88.8% 


Status Targets in Standard 3*5-6 CCR 


0.0 -69.9% 70.0 - 79.9% 


80.0 - 89.9% 90.0 - 100% 
Method for Calculating Progress 


Differentiated improvement targets are set for a given district or school based on the two prior years’ performance 
of that district or school. 


Example: Calculating the Progress Measure for “ABC” school district, the following example shows how the CCR*5-6 
Progress Measure is calculated at the district level using a rolling average: 


ABC district Year 3 (most recent year) 


percent of students who earn a 


qualifying score 85.0 93.3 88.1 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
(85.0 + 93.3) /2 = 89.2 


Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the 
CCR*5-6 Gap. 


Constant Years 1 and 2 Average % CCR*5-6 Gap 


100 ; 89.2 = 10.8 


Step 3 - The CCR*5-6 Gap is used to establish Progress Targets as determined by multiplying the CCR*5-6 Gap by 
the associated percentage, e.g. 25 percent for exceeding, 15 percent for on track, 5 percent for approaching. 
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Table 4. Generating Targets for Progress Measure 


% Increase Years 1 and 2 


Years 2 and 3 


Average Average 
CCR*5-6 Gap Needed percent Progress Target 
Exceeding 10.8 = 25% = Coll 89.2 91.9-100 
On Track 10.8 zs 15% = 1.6 89.2 
Approaching 10.8 * 5% = 0.5 89.2 89.7-90.7 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 


(93.3 + 88.1) /2=90.7 


Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is exceeding, on track, or 
approaching the required percent increase. In this example, the ABC school district has a Year 2 and 3 average 


percentage of 90.7, which means that it is designated as “Approaching” the Progress Target. 


Progress Targets in Standard 3*5-6 CCR 


<5% of CCR*5-6 5% of CCR*5-6 15% of CCR*5.6 25% of CCR*5.6 
Gap Increase Gap Increase Gap Increase Gap Increase 
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MSIP 5 Performance Standard 3: High School Readiness (HSR) 
(K-8 Districts only) 


High School Readiness (K-8 Districts) — The district provides adequate post-elementary preparation for all 
students. 


1. The percent of students who earn a proficient score on one (1) or more of the high school EOC assessments 
while in eighth grade meets or exceeds the state standard or demonstrates requiredimprovement. 


All available EOC assessments may be used toward Standard 3: High School Readiness. 


Data are obtained from the MOSIS June Enrollment and Attendance file and from official testing companies. 
Eighth grade students are defined as exiting in MOSIS data with a code of RO01 Remained Advanced. 
FAY does not apply to the HSR Standard. 


Example of supporting data format for APR 


Year 1 Year 2 Year 3 Status 


From MOSIS Number of Grade 8 students 


Number of Grade 8 students who 
From MOSIS pis 
: earned a qualifying score on a MAP 12 15 
and testing 
EOC assessment 
company 
19.0 16.6 26.8 


% of Grade 8 students earning a 
qualifying score 
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Method for Calculating Status 

The percent of Grade 8 students who earned a qualifying score on the MAP EOC assessments is determined by 
dividing the number of Grade 8 students who earned a qualifying score on the MAP EOC assessments by the total 
number of Grade 8 students, then multiplying by 100, and rounding to the tenth. 


The number of Grade 8 students is based on 
June Enrollment and Attendance Records 
with an Exit Code indicating the student has 
advanced to Grade 9. 


number of Grade 8 students 63 (Year 1) 


The number of Grade 8 students who earned a 
qualifying score ona MAP EOC assessment is number of Grade 8 students 
determined by the number of Grade 8 students | who earned a proficient or 
who earned a proficient or advanced score ona | advanced score ona MAP EOC 
MAP EOC assessment prior to advancing to assessment prior to Grade 9 
Grade 9. 


12 (Year 1) 


The percent of Grade 8 students who earned a a) number of Grade 8 students % of “exiting” Grade 8 
qualifying score on the MAP EOC assessments is 7 students who earned a 
: aa = 63 bes 
determined by dividing the number of Grade 8 qualifying score = 
students who earned a qualifying score ona 
MAP EOC assessment by the total number of 
Grade 8 students, multiplying by 100 and then 
rounding to the tenth. 


b) number of Grade 8 students 
who earned a qualifying 
score = 12 


12 /63 =0.190 


0.190 * 100 = 19.0% 


Status is determined by adding Year 1, Year 2, 
and Year 3 of the percent of Grade 8 students 
who earned a qualifying score on a MAP EOC 
assessment, dividing by three (unless three 
years of data are not available), and rounding to 
the tenth. 


19.0 + 16.6 + 26.8 = 62.4 
(Year 1 + Year 2 + Year 3) /3 
62.4 / 3 = 20.8% 


Status Targets in Standard 3 High School Readiness (HSR) 


0.0 - 11.9% 12.0 - 18.9% 19.0 - 24.9% 25.0 - 100% 


Method for Calculating Progress 
Differentiated improvement targets are set for a given district or school based on the two prior years’ performance 
of that district. 


Example: Calculating the progress measure for “ABC” school district, the following example shows how the progress 
measure is calculated at the district level: 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
(19.0 + 16.6) /2=17.8 


Step 2 - The average percentage for Years 1 and 2 is subtracted from 50 to determine the HSR*1 Gap. 


Baseline Years 1 and 2 Average percent HSR*1 Gap 


50 - 17.8 = 32.2 
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Step 3 - The high school readiness Gap is used to establish progress targets as determined by multiplying the high 
school readiness Gap by the associated percentage, e.g., 25 percent for exceeding, 15 percent for on track, 5 percent 
for approaching. 


Table 5. Generating Targets for Progress Measure 
HSR 


pee pee Increase pee Progress AMO 
P Needed P 
Exceeding 32.2 7 25% 7 8.1 17.8 25.9-100 
On Track 32.2 = 15% 7 48 17.8 22.6-25.8 
Approaching 32.2 si 5% = 1.6 17.8 19.4-22.5 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 

(16.6 + 26.8) /2 =21.7 

Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is exceeding, on track, or 
approaching the required percent increase. In this example, the ABC school district has a Year 2 and 3 average 


percentage of 21.7, which means that it is designated as “Approaching” the Progress Target. 


Progress Targets in Standard 3 High School Readiness (HSR) 


<5% of HSR Gap 5% of HSR Gap 15% of HSR Gap 25% of HSR Gap 
Increase Increase Increase Increase 
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MSIP 5 Performance Standard 4: Attendance Rate 


Attendance Rate — The district ensures all students regularly attend school. 
1. The percent of students who regularly attend school meets or exceeds the state standard or demonstrates 
required improvement. 


Attendance targets use the individual student’s attendance rate and set the expectation that 90 percent of the 
students are in attendance 90 percent of the time. 


Data are obtained from the MOSIS June Cycle Enrollment and Attendance file and from Core Data Screen10 
- School Calendar Information. 

Using the end of the year MOSIS June Student Enrollment Attendance, attendance rate is determined for 
every student grades K-12 who is reported any time in the district, school, or grade throughout the year. 
Students reported as Resident I, Non-Resident, DESEG-IN, Federal Lands, and Parent Tuition areincluded. 
Students with zero (0) hours of attendance are excluded. 

Any time a student transfers, changes grades, or changes residency status a new attendance “segment” is 
created for the student. For the purposes of this calculation, all segments in the same district, school, and 
grade are summed into a set of hours of attendance and absence for that entity. If however, the district, 
grade, or calendar hour total changes (buildings within the same district with differing calendar hours), 
then each segment is considered individually. 

Students with 85 percent attendance or greater will be proportionally weighted 0.25, and 87.5 percent 
attendance or greater will be proportionally weighted 0.5. Students with 90 percent attendance or greater 
continue to count proportionally as 1.0. An individual attendance rate is calculated for each student for the 
amount of time (segment) the student is enrolled in the district, school, and grade. Each individual rate is 
weighted in accordance with the proportion of the school year the student is enrolled in the district, school 
and/or grade. For example, a student who is in attendance over 90 percent of the time and is enrolled in the 
school for a full year would be proportionally weighted as a 1.0, whereas a student who is in attendance 
over 90 percent of the time and is enrolled for 522 hours in a school with a 1044 hour calendar would be 
proportionally weighted as a 0.5. 

Total hours enrolled is the total hours of attendance plus the total hours of absence. 

Total calendar hours are the actual total calendar hours recorded in Core Data Screen 10. Districts should 
confirm that a fully enrolled student’s hours of attendance + hours of absence is equal to the calendar hour 
total reported on screen 10 for the student’s attendance center. 

Student’s proportional enrollment is determined by taking the total hours enrolled in the district or school 
and dividing by the total calendar hours rounded to the thousandth. 

Students proportional weight or contribution is determined by taking the students proportional enrollment 
and multiplying by their proportional weight earned for reaching 85 percent (0.25), 87.5 percent (0.5) and 
90 percent (1.0) attendance. 

If a student drops out and returns at a later date, the Stop Out Code may be used for reporting purposes. A 
student’s absence must exceed 20 consecutive calendar days in order to use the Stop Outcode. 

Seniors who graduate early should be exited on their last day of attendance. This includes the end of the 
year when the entire senior class is finished before the rest of the district (before the end of the official 
school calendar). 


Method for Calculating Supporting Data 
The student’s attendance rate is determined by using the “hours of absence” method. This method is calculated by 
dividing the hours of attendance by the total hours enrolled, then multiplying by 100 rounded to the tenth. 


When calculating the district or school attendance rate the proportional weight of each student is used. The 
proportional enrollment is determined by taking the total hours enrolled in the district or school and dividing by the 
total calendar hours rounded to the thousandth. 
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Example: The following example shows how the attendance measure is calculated at the district level for a school 
district: 


Refer to the table below for examples of ten different students, labeled A - H. 


Step 1 - Determine the student’s hours of enrollment: 

Regular hours of attendance + regular hours of absence = hours of enrollment 
Student A) 277.4 + 29.5 = 306.9 
Student B) 973.0167 + 105.75 = 1078.8 
Etc. students C - H 


Step 2 - Determine the student’s proportional enrollment: 

Regular hours of enrollment/total calendar hours = proportional weight 
Student A) 306.9 / 1078.8= .28449 
Student B) 1078.7667 / 1078.8 = 1 
Etc. students C - H 


Step 3 - Determine the student’s attendance rate: 

Regular hours of attendance/hours of enrollment = attendance rate 
Student A) 277.4 / 306.9= 90.4 
Student B) 973.0167 / 1078.8 = 90.2 
Etc. students C - H 


Step 4 - Determine the points applied to each student based on their attendance rate: 
Student A & B are both above 90 percent = 1.0 
Students C & D are both between 87.5 percent & 90 percent =.5 
Students E & F are both between 85 percent & 87.49 percent = .25 
Students G & H are both below 85 percent = 0 


Step 5 - Determine the total proportional weight for the district or building (the denominator): 
Sum of the total proportional weight column, all students enrolled = 5.80994 


Step 6 - Determine the adjusted proportional weight each student contributes to the total: 
Multiply the proportional weight x attendance points 
Student A) 0.28449 x 1 = 0.284 
Student B) 1 x 1 = 1.000 
Etc. students C - H 


Step 7 - Sum the adjusted proportional weights to determine the numerator. 
Note students A-F contribute to the total, while students G & H do not as they are less than 85 percent 
attendance. 
= 2.331 


Step 8 - Divide the total adjusted proportional weight of each student 85 percent or greater by the total 
proportional weight possible to determine the district attendance rate for APR purposes. 
2.331 / 5.80944 = .4012 (40.1 percent) 
This is an extreme example with only ten students in the sample chart below. A typical small 
district might have an adjusted proportional weight of 290.000 and a total proportional weight of 
308.0000 for an attendance rate of 290.000/308.0000 = .9415 (94.2 percent). 


Comprehensive Guide to MSIP 5 - 2019 Page 44 


Regular Regular Hours of Proportional | Attendance | Calendar | Attendance | Adjusted 
Hours Hours Enrollment | Weight Rate Total Points Proportional 
Attendance | Absence Hours Weight 

A | 277.4 29.5 306.9 0.28449 90.4 1078.8 1 0.284 

B | 973.0167 105.75 1078.7667 | 1 90.2 1078.8 1 1.000 

C | 457.2666 55.9667 513.2333 0.47576 89.1 1078.8 0.5 0.238 

D | 962.3834 116.3833 | 1078.7667 | 1 89.2 1078.8 0.5 0.500 

E | 929.8334 148.9333 | 1078.7667 | 1 86.2 1078.8 0.25 0.250 

F | 219.0833 35.5167 254.6 0.23601 86.1 1078.8 0.25 0.059 

G | 914.1667 164.6 1078.7667 | 1 84.7 1078.8 0 0.000 

H | 737.9334 139.8333 | 877.7667 0.81368 84.1 1078.8 0 0.000 
Total 5.80994 2.331 


Standard 4: Attendance Status Targets 


0- 79.9% 80.0 - 84.9% 


85.0 - 89.9% 90.0 - 100% 
Method for Calculating Progress 


Improvement targets are set for district or schools based on the individual group’s prior two years of status. A three 
percent increase = “Exceeding”, a two percent increase = “On Track”, and a one percent increase = “Approaching”. 


Example: The following example shows how the Progress measure is calculated at the district level for a school 
district: 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 
(78.4 + 87.3) /2 = 82.9 

Step 2 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 
(87.3 + 88.9) /2 =88.1 


Step 3 - Subtract the average of Year 1 and Year 2 from the average of Year 2 and Year 3. The result is the amount of 
Progress. 


88.1 - 82.9 =5.2 


In the example below the school district has a Progress score of 5.2 percent, which places that district above three 
percent which results in a score of “Exceeding”. 


Table 6. Generating Standard 4: Attendance Progress 
3 Years of Attendance at or above the statestandard 
Year 1 Year 2 Year 3 


78.4 87.3 88.9 


(78.4 + 87.3) /2 (87.3 + 88.9) /2 
82.9 88.1 
88.1 - 82.9 = 5.2 
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Standard 4: Attendance Progress Targets 


<1% 
Increase 


1% 
Increase 


2% 3% 
Increase Increase 
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MSIP 5 Performance Standard 5: Graduation Rate 
Graduation Rate (K-12 districts) — The district ensures all students successfully complete high school. 


1. The percent of students who complete an educational program that meets the graduation requirements as 
established by the board meets or exceeds the state standard or demonstrates requiredimprovement. 


High schools and districts with high schools are required to meet a four-, five-, six- or seven-year Status Target or a 
combination of Status and Progress Targets for the four-, five-, six- or seven-year rate to receive full credit for 
graduation rate on the APR. The five-, six- and seven-year rates track students for up to seven years, but are 
otherwise calculated in the same manner as the four-year graduation rate. For example, the fifth-year students 
remain in their original cohort and that cohort is recalculated based on the aggregate number of students graduating 
with a regular diploma within a five-year timeframe. The four-, five-, six- and seven-year graduation rates are 
calculated, and the better of the four is used to determine if districts and schools have met the graduation rate target 
or have shown sufficient improvement. 


Data are obtained from the MOSIS June Enrollment and Attendance file. 

It is crucial that the First Freshman School Year is identified accurately for proper cohort yearidentification. 
Cohort year is calculated by adding four school years to the school year a student is first identified as a 
freshman in the MOSIS June Student Core, Enrollment and Attendance submission to determine when 
graduation should typically occur. For example, a freshman who enters school in August of 2019 has a first 
freshman school year of 2019-2020 and should be reported in MOSIS (FirstFreshmanYear = 2020). This 
student would be expected to graduate in the school year 2022-2023 (Cohort Year = 2023). 

Four-Year Adjusted Cohort Graduation Rate Definition - The four-year adjusted cohort graduation rate 
is the number of students who graduate in four years with a regular high school diploma divided by the 
number of students who form the adjusted cohort for the graduating class rounded to the tenth. From the 
beginning of 9th grade, students who are entering that grade for the first time form a cohort that is 
subsequently “adjusted” by adding any students who transfer into the cohort later during the 9th grade and 
the next three years and subtracting any students who transfer out, immigrate to another country, or die 
during that same period. 

Five-Year Adjusted Cohort Graduation Rate Definition - The five-year adjusted cohort graduation rate is 
calculated the same as the four-year with the exception that it includes both four- and five-year graduates in 
the fifth-year cohort. 

Six-Year Adjusted Cohort Graduation Rate Definition - The six-year adjusted cohort graduation rate is 
calculated the same as the four- and five-year rate with the exception that it includes four-, five-, and six- 
year graduates from the original 9" grade cohort. 

Seven-Year Adjusted Cohort Graduation Rate Definition - The seven-year adjusted cohort graduation 
rate is calculated the same as the four-, five-, and six-year rate with the exception that it includes four-, five-, 
six- and seven-year graduates from the original 9" grade cohort. 

Graduating Attendance Centers with grades 10, 11, 12 or 11, 12 - Attendance centers that do not 
include the 9" grade will use the same calculation as those attendance centers that include the 9" grade 
with the exception of substituting the next lowest grade level taught in the attendance center beyond the 92 
grade for the beginning of the adjusted cohort. 

Beginning with Cohort Year 2018, the measurement for graduation rate differentiates how students 
graduate. The definition of G01 is; Graduates with a regular diploma. 

The definition of G03 is: Graduated by earning some or all required credits through modified classes aligned 
with alternate state standards or by meeting IEP goals. This would generally be limited to those students 
with the most significant cognitive disabilities whose IEP teams have determined that this method of 
graduation provides FAPE to the individual student. 
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e Cohort Inclusion - Students are included in the district’s adjusted cohort when they become a first time 9% 
grader and enter the district with the following entry codes. 


$100 
T101 
T102 
T103 
T104 
T105 
T106 
T107 
T108 
T109 
T100 
R101 
R102 
R103 
R104 
E100 


Stop Out: Entry 

Transfer from a public school outside district but within state 
Transfer from public school within district 
Transfer from home school in state 
Transfer from private school in state 
Transfer from public school out of state 
Transfer from private school out of state 
Transfer from home school out of state 
Transfer from drop-out 

Transfer from another country 

Transfer from Unknown 

Remained: Advanced 

Remained: Retained 

Remained: Other 

Remained: Changed Grade 

Initial Entry 


Note: If the student is reported for the first time as a 9 grader and has an entry code of R102 - Remained Retained or 
R103 - Remained Other that student is placed in the prior year cohort based on the assumption that student had been 


retained one (1) year. 


e Cohort Exclusion - Students are removed from the district’s cohort if they exit the school district with the 
following exit status. 


TO01 
T003 
T004 
TO05 
T006 


T008 
TO09 


Transfer to a public school outside district but within state 
Transfer to home school in state 

Transfer to private school in state 

Transfer to public school out of state 

Transfer to private school out of state 


Transfer to another country 
Deceased 
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Example of the four-year cohort graduation rate calculation: 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


1) The number of cohort members 
who earned a regular high 
school diploma by the end of 
the starting cohort’s fourth high 
school year = number of cohort 
graduates reported in the MOSIS 
June Student Enrollment and 
Attendance. 


graduates = 900 


2) The four-year “adjustments” are 
reported in the MOSIS June 
Student Enrollment and 
Attendance File. 


3) The four-year adjusted cohort is 
calculated based on reported 


2016: First Time 9" Graders (Starting 
Cohort 2016 members)+ Transfers in - 
Transfers out 

(2016 Starting Cohort were freshman in 
the 2015-2016 academic year) 


1,000 + 0 - 50 = 950 


2017: Cohort 2016 + Transfers in - 
Transfers out 


950 + 25-50=925 


2018: Cohort 2016 + Transfers in - 
Transfers out 


925+ 75-25 =975 


Class of 2019: Cohort 2016 + Transfers in 
- Transfers out 


(1,000 - 50) + (25 - 50) + (75 - 25) + (50 - 


975 + 50-25 = 1,000 


950 - 25+50+ 25 =1,000 


time 9t graders in the starting 
cohort plus students who transfer 
in, minus students who transfer 
out, emigrate, or become deceased 
during the cohort’s four high 
school years, then multiplying by 
100 rounded to the tenth. 


b) 


adjustments. 20) 
4) The four-year adjusted cohort 
graduation rate is determined by 
dividing the number of cohort 
graduates by the number of first- | a) number of four-year cohort 


graduates or less = 900 


number of adjusted cohort members 
= 1000 


900 / 1,000 = 0.900 


0.900 * 100 = 90.0% 


5) The district or school’s Status is 
determined by adding Year 1, Year 
2, and Year 3 of the adjusted 
cohort graduation rate and 
dividing by three rounded to the 
tenth. 


(Year 1 + Year 2 + Year 3) /3 


87.3 + 88.8 + 90.0 = 266.1 


266.1 / 3 = 88.7% 
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Example of the five-year cohort graduation rate calculation 


Explanations of Calculations Examples of Data Examples of Calculations 


1) The number of cohort members 
who earned a regular high school 
diploma by the end of the cohort’s 
fifth high school year is reported in graduates = 920 
the MOSIS June Student Enrollment 
and Attendance. 


2015: First Time 9t4 Graders 
(Starting Cohort 2015 members) 1,000 + 0-50 = 950 
+ Transfers in - Transfers out 


2016: Cohort 2015 + Transfers in 


- Transfers out 950+ 25-50=925 


2) The five-year “adjustments” are eae 
reported in the MOSIS June Student | 2017: Cohort 2015 + Transfers in 


925 +75-25=975 
Enrollment and Attendance File. - Transfers out rf 


2018: Cohort 2015 + Transfers in 


- Transfers out 975 + 50-25 = 1,000 


2019: Cohort 2015 Transfers in - 


Cohort 2015 Transfers out 1,000 + 10 - 5 = 1,005 


3) The five-year adjusted cohort is 
calculated based on reported 
adjustments. 


(1,000 - 50) + (25-50) + 


(75 - 25) + (50 -25)+(10 - 5) 950 - 25+50+25+5=1,005 


4) The five-year adjusted cohort 
graduation rate is determined by 
dividing the number of cohort 
members who earned a regular high 
school diploma by the end of the a) number of five-year cohort 
cohort’s fifth high school year by the graduates = 920 
number of first-time 9 graders in 
the starting cohort plus students who | b) number of adjusted cohort 
transfer in, minus students who members = 1,005 
transfer out, emigrate, or become 
deceased during the cohort’s five 
high school years, then multiplying 
by 100 rounded to the tenth. 


920 / 1005 = 0.915 


0.915 * 100 = 91.5% 


5) The district or school’s Status is 


determined by adding Year 1, Year 2, 88.3 + 89.8 + 91.5 = 269.6 
and Year 3 of the five-year adjusted | (Year 1+ Year2+ Year 3) /3 
cohort graduation rate and dividing 269.6 / 3 =89.9% 


by three rounded to the tenth. 


Standard 5: Graduation Status Targets (Four-, Five-, Six- or Seven-Year Rate) 


85.0 - 89.9% 90.0 - 100% 


0- 79.9% 80.0 - 84.9% 
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Method for Calculating Progress 
Improvement targets are set for districts and schools based on the individual group’s three-year average for Status. 


If Status = On Track or 


If Status = Floor If Status = Approaching Target 
Target = 9% Target = 6%  Target= 3% 
On Track = 6% On Track = 4% On Track = 2% 
Approaching Target = 3% Approaching Target = 2% Approaching Target = 1% 


Example: The following example shows how the Progress Measure is calculated at the district level for a school 
district: 


Step 1 - Determine the Status of the district. In this example, the district’s three-year average = 89.9 percent, which 
means it is “On Track” with the Status Measure; as a result, the district’s rolling average targets are three percent 
target, two percent on track, and one percent approaching. 
Step 2 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to the tenth. 

(88.3 + 89.8) /2 =89.1 
Step 3 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to the tenth. 

(89.8 + 91.5) / 2 =90.7 
Step 4 - Subtract the average of Year 1 and Year 2 from the average of Year 2 and Year 3. The result is the amount of 
Progress. In the example below the school district has a Progress Score of 1.6 percent, which places that district 


between one percent and two percent, which results in a score of “Approaching”. 


Table 7. Generating Graduation Progress 
3 Years of Graduation Rate 


Year 1 Year 2 Year 3 


88.3 89.8 91.6 
(88.3 + 89.2) /2 (89.8 + 91.5) /2 
89.1 90.7 


90.7 - 89.1 = 1.6 


Standard 5: Graduation Progress Targets (Four-, Five-, Six- or Seven-Year Rate) 


If Status = Floor, 6% If Status = Floor, 9% 
increase needed increase needed 


If Status = Approaching, 
4% increase needed 


If Status = Floor, 3% 
increase needed 
If Status = 
Approaching, 2% 
increase needed 
If Status = On Track or] If Status = On Track or If Status = On Track or 
Target, 1% increase Target, 2% increase Target, 3% increase 

needed needed needed 


If Status = Approaching, 


<Stated increase 6% increase needed 
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Classification / Accreditation Process 


Three APRs, each reflecting three years of performance data, will be used for classification 
recommendations. 


ELA or MA may not be used to lower a district’s classification as long as 2018 data is included. Science may 
not be used to lower a district’s classification as long as 2019 data is included. Social studies may not be 
used to lower a district’s classification as long as 2020 data is included. 


Step 1 - DESE produces the district’s APR, which provides an objective analysis of each district’s attainment of the 
MSIP 5 Performance Standards and Indicators. A district’s Accreditation Classification remains intact until the State 
Board of Education rules otherwise. 


Step 2 - DESE reviews each district’s accreditation status and the APR supporting data for the three most recent 
APRs to identify trends and status in performance outcomes. If data trends indicate that the district’s full 
accreditation is or may be in jeopardy, the district may be asked to submit its Comprehensive School Improvement 
Plan (CSIP) to DESE and assistance through the Regional School Improvement Team (RSIT) may be activated. 


Step 3 - DESE shall use the data review process described in “Step 2” to make accreditation classification 
recommendations to the State Board of Education. Recommendations are made based on APR status, APR 
trends and include other factors including the district’s CSIP, previous department MSIP findings, financial 
status, statutory and regulatory compliance, and the employment of an appropriately certificated 
superintendent of schools. Recommendations regarding accreditation classification are presented to the State 
Board of Education for its approval. Districts are notified by DESE of the accreditation classification assigned by the 
board. 

e Atany time the state implements a new statewide assessment system, develops new academic performance 
standards, or makes changes to the Missouri School Improvement Program, the first year of such statewide 
assessment system and performance indicators shall be utilized as a pilot year for the purposes of 
calculating a district’s APR under the Missouri School Improvement Program. The results of a statewide 
pilot shall not be used to lower a public school district’s accreditation (161.855.4, RSMo). Ex. ELA or MA 
may not be used to lower a district’s classification as long as 2018 data is included. Science may not be used 
to lower a district’s classification as long as 2019 data is included. Social studies may not be used to lower a 
district’s classification as long as 2020 data is included. 


Note: DESE will not make a recommendation to raise a district’s classification based on the utilization of 
the hold harmless transition. 
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MSIP 5 Annual Performance Report Notes 


Standard 1: Academic Achievement 


The accountability year begins with the summer administration of any EOC assessments or MAP-A. 
Algebra I, English IJ and Biology contribute to the calculation of the APR in Standards 1 and 2. In addition to 
Algebra I, other MA EOC’s may contribute to the APR, based on the students MA coursestaken. 


The district will determine which MA assessment, the GLA or EOC, is the most appropriate measure for each 
individual student. 

Once a student has scored proficient or advanced on the same EOC assessment in a prior year, DESE will 
remove duplicate proficient/advanced scores. Refer to MAP Data Download file student test to identify 
those students with duplicate scores. 


Standard 2: Subgroup Achievement 


The super subgroup is used for accountability determinations in the APR. 

For LEAs and schools participating in the CEP, the super subgroup will be the same as the “all students” 
group in Status Measures and Progress Measures. However, Growth Measures may vary between standard 
1 and standard 2 due to the comparison of the performance in total group versus super subgroup. 


Standard 3: College and Career Readiness (K-12) 


Approved IRC’s are included in the APR. 
Test Scores for high school level PLTW are included in the APR. 
Students coded as both GO3 & MAP-A will be excluded from 3*1-4, but will be included in 3*5-6. 


Standard 3: High School Readiness (K-8) 


Calculation for the APR is based on three years of data. EOC tests taken in MA, science, and/or ELA will be 
included in the academic achievement indicator, the subgroup indicator and the high school readiness 
indicator. If one student takes multiple EOC tests, the single highest score would be included in the high 
school readiness indicator. 

K-8 districts and charters may continue to earn HSR if they are growing a high school until they have their 
first senior class graduates. 

Both required and optional EOCs may be used toward Standard 3: High School Readiness. 


Standard 4: Attendance 


The Stop Out Code provides districts an appropriate way to report students who dropped out and then 
returned at a later date having been out of school for unknown reasons an extended period of time. Data- 
reporting parameters have been implemented to fulfill requests from districts that DESE establish clear 
guidance for self-reported APR supporting data to ensure a more standardized approach across the state. 
The Stop Out Code may not be used unless the absence exceeds 20 consecutive calendar days. Districts 
will receive an error message for the use of a Stop Out Code for fewer than 20 consecutive calendar days 
and will not be able to certify their data. 

For the calculation of the APR, students with 85 percent attendance will now count proportionally as 0.25 
and 87.5 percent will count proportionally as 0.5. Students with 90 percent or greater attendance will count 
1.0. 


Standard 5: Graduation Rate 


The four-, five-, six- and seven-year graduation rates are calculated, and the better of the four is used for 
APR determinations. The four-year rate could first be calculated with 2011 graduates. The five-year rate 
could first be calculated with the 2012 graduates. The six-year rate could first be calculated with the 2013 
graduates. The seven-year rate could first be calculated with the 2014 graduates. The 2018 APR includes 
three years of data for the four-, five-, six- and seven-year rates. 

The seven-year adjusted cohort graduation rate is calculated the same as the four-, five-, and six-year rate 
but will include four-, five-, six- and seven-year graduates from the original 9" grade cohort. 

The total number of graduates in the denominator is the sum of students reported as GO1 andGO3. 
Graduates coded as GO3 are not included in the numerator (regardless of MAP-A status). 
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Appendices 
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Appendix A - Assessment Scores Matrix 
Standard 3: College and Career Readiness*1-3 


| 
| | 
Composite Score eee < 18-21 22-25 26 - 36 


|New SAT® scores 
as of March 2016 940-1090 | 1100-1230| 1240-1600 


(prior SAT scores) 


Algebra < 66 and i Reading = 
Reading < 81 than cut than cut 
scores scores 


Algebra + Reading 


Armed Forces 
Qualification 
Test Score 


<250 Reading 
<230 Math 


: (***QAS, AAF) 
Next Generation Next Generation Reading OR 


[Math (QAS, AAF) (<85 Reading thenicut | cut scores 


<116 Algebra ete 
Classic) 


{Versions 2.0 and (1.0) 


3 or below 


Graphic Literacy 
(Locating 
| Information) 


*Based on College Board Concordance Tables. 

**The lowest subtest score of the three WorkKeys tests determines the level/points, not an average or 
combined score. Score is based on level obtained and not scale score. Districts may reassess students in a 
single area to try and raise the lowest subtest. 

In 2018, WorkKeys is transitioning to a new version. Students must take all three tests of the new version if 
attempting to raise their score (if they are trying to raise an old version score as old versions are no longer 
available). 

Note: Refer to the APR Supporting Detail Reports to verify student data. 


***QAS-Quantitative Reasoning Algebra & Statistics 
*** AAF- Advanced Algebra Functions 
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Appendix B - Advanced Credit and Credential Matrix 


Standard 3: College and Career Readiness*4 


No record of | Norecord of No record of No record of No record of 
participation or| participation or| participation or participation or participation or earn 
earn <B earn <B score<6 Score < proficient <B 


Earn “B” or Earn “B” or Earn “B” or greater in 
greater in greater in department approved 
department department Earn an IRC dual credit course or 
approved AP | approved IB dual enrollment 
Course Course course 


Exam score of > 6 
on approved PLTW 


Exam score of >| Exam score of 


Note: Calculation of earning a “B”, remove any ‘+’ or ‘-’ associated with the grade, and use the scale below. The 
divisor is contingent on the course time units (i.e. semester use a divisor of two, quarters use a divisor of four, 
etc.) 


Student Course Course Course Time 
Name MOSIS ID No. Name Unit Grade Earned Scale: 
Smith, John 11111111 115795 ie Semester 1 A = 4.0 
Smith, John 11111111 115795 a elles Semester 2 B = 3.0 
Avg. grade: 2+4=6 6/2 =3 which equals a'B' 7 10 


Student Course Course Course Time 
Name MOSIS ID No. Name Unit Grade Earned 


Smith,John 11111111 134221 Physiology Semester 1 C- 
Smith, John 11111111 134221 Physiology Semester 2 B+ 


Avg. grade 2+3=55/2 =2.5 which equals a 'C' 
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Appendix C - Dual Credit Institutions 


Standard 3: College and Career Readiness*4 


ase | 


University of Missouri - St. Louis 


< | 201 


Missouri institutions complying with the Coordinating Board for Higher Education’s Dual Credit Policy and Principles of Good 
Practice for Dual Credit Courses. Link here to current Dual Credit list. 


Columbia College (515712) Vv (116118) Vv 
Cleveland University - KC (703617) Vv | Central Methodist University (630984) | V)/V| V/V 
Crowder College (166166) Vv} v¥{v | Vv | Culver Stockton College (018750) Vv 
East Central College (130130) V |v |v |v | Drury University (603541) SOSA 
Jefferson College (145145) Vv |vJv |v | Fontbonne University (038603) Vv 

Lincoln University (117117) V |v |v | V | Hannibal-LaGrange University (041544) | V| V| Vv] Vv 
a Collces opraly Line) V |v] vV | -¥V | Lindenwood University (018759) Viviviv 
Metropolitan Community Colleges Maryville University of St. Louis 

(161161) palace (041639) ee 
Mineral Area College (163163) Vv |v |v |V | Missouri Baptist University (041538) Viviviv 
MO Southern State University (143143) Vv |v |v | Vv | Missouri Valley College (514772) a IO Sl | ay 
MO State Uaiver sty “SP ane aeT V¥ |v | v/v | Park University (511931) Vivi Vv 
(119119) 

ne aa SAS Vv |v | Vv | ¥ | Rockhurst University (501839) SV vallevaliy 
MO Western State University (160160) V |v |v |v | St. Louis University (300310) Vivi viv 
ce tea Gommaunity College Vv |v |v | Vv | Southwest Baptist University (635440) | V| Vv] V/V 
North Central Missouri College (198198) Viviviv Stephens College (005177) Viviviv 
Northwest Missouri State University : F 

(118118) Vv |v | Vv | ¥ | Webster University (300335) Vv Viv 
Ozarks Technical Community College Wentworth Military Academy & Jr. 

(640121) Viv | viv College (054407) Viv |v 

St. Charles Community College (146146) Vv 

St. Louis Community Colleges (149149) Viviviv 

Southeast Missouri State University 

(120120) Vlas |e 

State Fair Community College (126126) Viviviv 

Three Rivers Community College 

(200200) ee 

Truman State University (122122) Viviviv 

University of Central Missouri (121121) VO ae led 

University of Missouri - Kansas City flak | af | af 


(116117) 


v= Indicates year the Missouri institutions were used for MSIP 5 accountability 
*Williams Woods University - Offers Dual Enrollment and not Dual Credit 
Higher Education updates this list in October and March. Institutions must be included on the March update 


to be included in the APR. 
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Appendix D - Career Education Placement/Follow-Up Guidelines 
Standard 3: College and Career Readiness*5-6 


Follow-up data is reported on the previous year’s graduates, based on the status of the graduates 180 days 
following their exit from career education training. Each graduate should be reported in only one career 
education program area. Districts should collect follow-up information on any student who graduated high 
school and received credit in at least one state-approved career education course (excluding Exploring 
Agriculture, Industrial Technology, and Exploratory Family and Consumer Sciences (FCS) and the Family 
Focused courses from program code 06-04) during grades 9-12. Districts should collect follow-up data on any 
student taking a credit in a state approved career education Family and Consumer Sciences program 
(program code 0704). If students completed state-approved career courses at the comprehensive high school 
and the area career center, their follow-up data should not be reported for both locations. The area career 
center is responsible for providing each sending school with the appropriate follow-up data for students that 
attend the area career center. The sending school will be responsible for entering that information into 
MOSIS. 


If the graduate is employed and continuing their education, use the following guidelines: 


A graduate attending school (full- or part-time) and employed (full- or 
Employed Related part-time) in a field for which they were trained, should be reported as 
“employed related” (Emp Rel). 

A graduate attending school (full- or part-time) in a field for which they 
Employed Related were not trained, but employed (full or part-time) in a field for which they 
were trained should be reported as “employed related” (Emp Rel). 

A graduate attending school (full- or part-time) in a field for which they 
were trained, but not employed in a field for which they were trained 
should be reported as “continuing education related” (Ced Rel). 


Continuing 
Education Related 


For additional guidance on employed related, please see Missouri Connections Website. 


Note: In accordance with legislation, the definition of placement for graduates who complete approved career 
education programs will be expanded within MSIP. Districts will continue to report “Related” and “Not 
Related” placement for Perkins purposes, and DESE will capture both populations for credit within Standard 
3*5-6. 
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Appendix E - Data Corrections and Appeals 


Districts and buildings should regularly check their data for accuracy. Staff will require student level access to 
see all the available data that impacts the APR. 


Navigating to the School Performance & Accountability Reports 


Log in to DESE Web Applications 

Select DESE MCDS Rewrite from the list of DESE Web Applications 

In the left navigation under Districts, Charters, & Schools, select School Performance & Accountability 
At the top of the screen, select Reports and Resources 


Pow Ne 


STATE OF MISSOURI 


At-A-Glance Reports and 


a Collapse All — Show All Content 


School Performance & Accountability @ 


} @ District Missouri School Improvement Program 5 (MSIP5): District/Charter APR Summary Re; - Secured 
Report Card @ charter This report displays the total points earned by the district or charter school in each MSIP5 Standard. 


ee | ae 
——— MSIP5 School Summary Report - Secured 


At-A-Glance Information This report displays the total points earned by the school for each MSIPS Standard. 
Directory, Calendar, & Maps 
School Performance & 


Accountability 


; MSIP5 Supporting Data Report - Secured 
(Cotlege & Career Eduoation This report displays the data used in calculating the district's or charter school's points earned for each MSIP5 Standard. 
School Finance Data 


ee MSIP5 School Supporting Report - Secured 
— — This report displays the data used in calculating the school's points earned for each MSIP5 Standard. 


Students 


Achievement Level Detail Report 
This report displays the percent of students scoring at the different achievement levels. 


Educator Preparation 


Standard 3 -- LEA CCR Indicator 1-4 (ACT, SAT, COMPASS, ASVAB, AP, IB, Dual Credit/Enroll, IRC) 


Special Education This report displays the district's or charter school's number of graduates and the CCR Indicator 1-4 points earned for MSIP5. 


Comprehensive Guide to MSIP 5 Page 59 


Data Corrections and Appeal Procedures 

There are serval types of data corrections and appeals. For any situation that does not fit one of the specific 
situations described below, refer to the last item on this page, Miscellaneous Data, Administration or 
Assessment Anomalies. 


Types of Appeals 

Score/LND (Assessment Appeal Form and cost) 

CCR data (CCR Appeal Form) 

A+ retesting (district letterhead) 

MAP-A transfers (district letterhead) 

Medical Waiver (district letterhead) 

Miscellaneous Data, Administration or Assessment Anomalies (district letterhead) 


Score/LND Appeals 

There is an appeal window during which districts may submit appeal requests. There is a cost for appeals that 
are submitted to the testing companies for rescoring/LND. For additional information, or to obtain the form, 
go to 

http://www.dese.mo.gov/quality-schools/accountability-data/appeals-procedure 

GLA/EOC appeals detailed procedure 


CCR Data Appeals 

Once the APR is released, districts have approximately one month to correct and/or appeal the data received 
by the various testing companies (ACT®, SAT®, ASVAB, ACCUPLACER®, ACT WorkKeys®, AP®, IB®, etc.). For 
additional information, or to obtain the form, please visit our website. 


A+ Retesting 

Students retesting to achieve proficiency on the Algebra I assessment for A+ purposes, may be removed from 

accountability by submitting an appeal on district letterhead. Letters must contain the information included 

below in the section titled district Letterhead Requirements. 

e Guidance: An assessment year begins with the summer administration and ends with the subsequent 
spring - Summer /Fall/Spring. 

e  Ifastudent takes the same EOC more than once in the same assessment year, the last score is kept for 
accountability purposes. 

e §©6Ifastudent takes the same EOC in a different assessment year (Summer/Fall/Spring), accountability does 
not allow multiple Proficient or Advanced scores. The second proficient or advanced score will be 
removed. 

e = If the first score is Below Basic or Basic, and the next years score is Proficient or Advanced, the Proficient 
or Advanced score is kept. 

e Ifthe student scores Below Basic or Basic both times, the district must notify accountability to remove 
the second score. 
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MAP-A Transfer Appeals 

If a student transfers out of a district/charter during the portfolio collection the district/charter must submit 
a letter, on district/charter letterhead, with the date the student transferred. These instructions are also 
included in the MAP-A Administration Manual. Letters must contain the information included below in the 
section titled district Letterhead Requirements. 


Medical Waiver Appeals 

An appeal may be submitted on district/charter letterhead for students experiencing an acute (short-term) 
illness that prevents the student from receiving instructional services. In addition to the information below 
under district Letter Head Requirements, the committee requires student attendance records and 
homebound status. 


Miscellaneous Data, Administration or Assessment Anomalies 

For any situation not outlined above, provide the information below under district/charter letterhead 
requirements, including an explanation of the situation and send to accountability at the fax number 
provided. 


Letterhead Requirements 
The following information must be included in your written request on district/charter letterhead: 
¢ Student Name 
e MOSIS ID 
¢ Date of birth 
¢ Grade 
¢ County-District Code 
¢ School Code 
e Content Area 
¢ Brief explanation of reason for appeal 
¢ Signed by Superintendent/Head of School 
e Fax to: 573-526-3045 
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Appendix F - MA Accountability Guidance 


Middle 6th MAP MAP MAP MAP Al 
School 7th MAP MAP Al Al GE 
Sth MAP Al GE A2 A2 
High Qth “Algebra I GE-optional *A2 “GE *Submit Plan 
School (A1) 
1Qth | Geometry (GE) | *A2 
- optional 
11th | Algebra II (A2) 
- optional 


Notes: 


*When the content of A1, GE, and A2 are all taught and assessed prior to HS, the district or charter 
must submit the Personalized Accelerated Math Plan for HS MA accountability for the student. 
Within the same district or charter, if the A1 content is taught prior to grade 9, but the A1 EOC not 
given, the district or charter must give the Al EOC in HS (grade 9-12). 

For any student above, the Achievement Level 4 report/chart ONLY pulls MAP data for 3-8 grades. 
EOC data is pulled by EOC Assessment, regardless of the student's grade when taken. 

When an EOC is given prior to grade 9, the EOC score replaces the grade level MAP assessment. If the 
student scores below basic/basic, Al may be retaken in HS for accountability purposes. For A+ 
purposes, see #5 below. 

A+ Scholarship eligibility: Students are required to earn a score of proficient or advanced on the A1 
EOC. When a student scores below basic or basic they may retake the A1 to gain A+ eligibility (ora 
higher level DESE approved EOC in MA. See the Higher Ed website for other options for A1 
proficiency). The subsequent score will count for accountability (even if below basic or basic) unless 
the district or charter requests the score be removed through the appeal process. 

Courses do NOT have to be taught in the grade or sequence shown above, those are for illustrative 
purposes only. 

Grades 9-12 are considered "High School" for EOC accountability, even in buildings with different 
grade span configurations. 


* required EOC for student to avoid a graduate LND 


EOC Exception Codes 


EOCEX2: Student received content out-of-state; in a private, parochial or home school. 
EOCEX3: MAP-A- Students identified by the IEP team received content without an alternate 
assessment available. Currently this is only applicable to Social Studies. 

EOCEX4: Student took content in another public Missouri district, but was not assessed. 
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Appendix G - Description of the Missouri Growth Model 


Standard 1 & 2: Academic and Subgroup Achievement 


Conceptual Overview 

The Missouri Growth Model used in the state’s district and school accountability framework is a regression- 
based statistical analysis of the observed relationships between prior and current year scores on the MAP 
exam. The statistical analysis is conducted in two steps. 


The first step predicts MAP scores for individual students tested in the current year based on their prior year 
scores and the average prior year scores for all students tested in their school and district, along with a few 
other variables described in more detail below.! The difference between the observed score and predicted 
score for each student (the student’s residual) is the key value derived from the first-stage regression. 
Positive residuals indicate the student did better than predicted and negative residuals indicate the student's 
score was lower than predicted. 


The second-stage regression then groups students’ residuals by district or school and provides an average 
growth measure for each district or school, with a standard error that is used to evaluate the statistical 
significance of the resulting measures. 


Procedural Overview for Calculating MSIP Standard 1 Growth Measures 
The following steps are conducted each year to estimate the Missouri Growth Model. 


1. Standardize current year MAP scores 

2. Construct score pairs for each student from current year and prior year MAP scores 

3. Add data for other regression variables to the score pairs 

4. Run stage 1 regressions and retrieve student residuals 

5. Combine current year residuals with residuals from prior 2 years and run stage 2 regressions 

6. Test average growth measures for statistical significance and convert them to Normal Curve 
Equivalent units, district- or school-level standard deviation units, and percentiles for presentational 
purposes 


Each step in this procedure is described in more detail below. 


1. Standardize current year MAP scores 
All MAP score records with a scale score from the most recent testing year are retrieved and sorted by 
grade and subject. The mean and standard deviation for each subject and grade combination are 
calculated and used to convert the observed scale score values to z-scores. The z-score for a scale score in 
subjects and gradeg is calculated using the following formula: 
Zsg = (Observed Score - Mean Scoresg) 
Standard Deviationsg 


Conceptually, the z-score is a measure of how much a score differs from its sample mean and is measured 
in standard deviation units. For example, a z-score of 1 indicates a scale score one standard deviation 
above the mean (roughly the 84* percentile) for the grade and subject, while a z-score of -1 indicates a 
scale score one standard deviation below the mean (roughly the 16" percentile) for the grade and 


1 The inclusion of both school and district-level average prior year scores is a model refinement implemented 
in 2018. In previous years, district-level averages were included in the first-stage model when estimating 
district growth and school-level averages were included when estimating school growth. 
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subject. Using standardized scores allows combining scores with different scales in statistical analyses. 
Scale scores are standardized each year for the subject and grade level combinations shown below in 
Table 1. 


Table 1: Subjects and grade levels where z-scores are calculated from MAP scale scores 


Communication Arts MA Algebra I? 
3 3 
4 4 
5 5 
6 6 
7 7 7 
8 8 8 


2. Construct score pairs for current year MAP scores 
A valid score pair for a student is a MAP score from the current year linked with a MAP score from the 
prior year in the same subject and prior grade level. The first score pairs available are constructed by 
matching grade 4 scores from the current year with grade 3 scores for the same student and subject from 
the prior year. The last score pairs available have grade 8 scores matched to prior year grade 7 scores for 
the same student and subject.’ 


All matches are evaluated to make sure the grade from the prior year is one grade less than the grade for 
the current year. Cases where grade-level progression is not as expected are dropped (e.g., when a 
student is tested in the same grade 2 years in a row or appears to have skipped a grade between years). 


3. Add data for other regression variables to score pairs 

The following variables are added to the records to be analyzed in the stage 1 regression. 

e Student’s prior year MAP score from the “other” subject. For example, if MA is the subject being 
analyzed, then the prior year score from communication arts is added to the variables used to predict 
the current year MA score; conversely, when growth is being estimated for communication arts, the 
prior year MA score is the “other subject.”4 The other subject information is included as it improves 
the model’s predictive ability. For example, if two students have the same prior year score in MA, the 
model can leverage differences in prior year performance in communication arts to determine which 
student is predicted to score higher on the current year MA exam. 

e =©An indicator variable changed from 0 to 1 when the student was in the building where tested less 
than a full academic year. 


2 Separate regressions are run for students in grade 7 or 8 who have an Algebra I End of Course exam score, 
so the mean and standard deviation for grade 7 Algebra I test takers are used to standardize the 7‘ graders’ 
Algebra I scores and the mean and standard deviation for grade 8 Algebra I test takers are used to 
standardize the 8 graders’ Algebra I scores. Note that students with Algebra I EOC scores are NOT included 
in the regressions for the grade 7 and grade 8 MA scores. 

3 Students with Algebra I EOC scores in grade 7 or 8 are matched to prior year MA scores from the prior 
grade. This means grade 7 Algebra I EOC scores are predicted by prior year grade 6 MA scores and grade 8 
Algebra I EOC scores are predicted by prior year grade 7 MA scores. 

4Students MUST have a prior year score from the same subject to be included in the growth model. However, 
those with a missing prior year “other” subject score are kept. The other subject score is set to the state mean 
z-score of zero, and a variable indicating that the other subject score is missing is set to 1. We also include an 
interaction term to allow the same-subject prior-year score to have more predictive weight in the case of 
missing other subject data. This method allows students with missing other subject scores to be kept in the 
stage 1 regression, while leveraging the available information to produce the best prediction possible. 
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e The prior year average score in the same subject and the “other” subject for the school and district 
where the student was tested, calculated for all students who were tested in the school and district in 
the current year. 

e = The percent of students in the school and district who are flagged as in the building where they took 
their MAP test less than a full academic year. 

e The percent of students in the school and district with missing off-subject scores. 


4. Run stage 1 regressions and retrieve residuals 
A separate regression model is fit for each subject and grade combination with the student’s current year 
score as the outcome variable and the student’s prior year scores and the variables listed under item 3 
above as predictor variables. There are 5 regressions run in communication arts and 7 regressions run in 
MA every year. Residuals from these regressions are calculated and saved with the district and school 
identifiers indicating where the student was tested in the current year. 


5. Combine current year residuals with residuals from prior 2 years and run stage 2 regressions 
All residuals for a subject from the current and prior 2 years are combined into a single data set and 
analyzed using a regression model that includes only school or district IDs as the predictor variables. 
When the predictor variable is district ID, then the stage 2 regression produces the average residual ina 
subject for each district based on all students tested in the districts over three years. When the predictor 
variable is school ID, then the stage 2 regression produces the average residual in a subject for each 
school based on all students tested in the schools over three years.5 


6. Test average growth measures for statistical significance and convert them to Normal Curve 
Equivalent units, district- or school-level standard deviation units, and percentiles for 
presentational purposes 
The student level residuals and the average residuals for districts and schools are initially reported in 
student-level exam score units. For example, a district-level communication arts measure of 0.07 means 
that, on average, students in the district scored 0.07 standard deviations higher than predicted on the 
MAP communication arts exam. The stage 2 regression results also include a t-statistic for each unit 
analyzed (district or school) that allows for determining if the average of student residuals in the unit is 
reliably distinguishable from zero. Average residuals greater than zero and statistically significant 
indicate that, on average, MAP performance of students in the unit exceeded predicted performance in a 
statistically meaningful way. Average residuals less than zero and statistically significant indicate that, on 
average, MAP performance of students in the unit was below predicted performance in a statistically 
meaningful way. Average residuals that are not statistically significant cannot be reliably distinguished 
from zero, indicating that, on average, students’ MAP performance in the unit was not reliably different 
from predictions. 


Individual student residuals and average residuals for districts and schools expressed in z-score units are 
also converted to Normal Curve Equivalent units (NCEs) using the formula shown below. 


NCE = 50 + (21.063 * z-score) 


Student residuals and unit average growth estimates that are positive generate NCE values greater than 
50; residuals and averages less than zero generate NCE values less than 50.6 As an example, a district- 


° The standard errors of the stage 2 model are clustered at the student-level to account for repeated student 
observations over time. In addition, post-estimation Bayesian shrinkage methods are applied to the school 
and district estimates to account for varying degrees of noise across districts and schools. 

6 NCEs are designed so that the NCE and percentile measures are aligned at the 1st, 50, and 99" percentiles. 
For example, a student at the 1t percentile of a normal distribution will also have an NCE measure of 1, while 
a student at the 99" percentile will have an NCE of 99, and a student at the 50 percentile will have an NCE 
measure of 50. However, NCEs and percentiles are not aligned at any other point in the distribution. One 
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level communication arts NCE measure of 51.5 means that students in the district scored, on average, 1.5 
NCE units higher than predicted on the MAP communication arts exam. 


Two additional conversions are also applied to the district- and school-level estimates. The first 
conversion takes the initial estimates measured in student exam score units and converts them to district 
(or school) level standard deviation units. For these measures, a value of 0.86 indicates that the district 
performed 0.86 standard deviations higher than the average district in the state in terms of student exam 
score growth in the relevant subject, while a measure of -0.52 indicates that the district performed -0.52 
standard deviations lower than the average district in the state. The second conversion presents the same 
information in district (or school) level percentile measures. Here, a value of 65 indicates that the district 
is in the 65" percentile of districts in the state with respect to student exam score growth. 


As a final note, it is important to realize that the various conversions described above are purely 
presentational in nature and have no impact on the estimation of the district (or school) effects, nor on 
their statistical significance. 


Super-subgroup Growth Measure Calculation 

To produce the super-subgroup growth measures, steps 5 and 6 from the above process are repeated using 
only student residuals from students identified as belonging to the super-subgroup. A student is identified as 
a member of the super-subgroup if their MAP exam score record indicates that they are black or Hispanic or 
FRL eligible or receiving English as a second language or special education services.’ In addition, prior to step 
6, the super-subgroup growth measures at each level (district or school) are re-centered to have an overall 
mean of 0. The re-centering modifies the interpretation of the average residual so that a positive and 
statistically significant estimate indicates that, relative to model predictions, the super-subgroup students in 
the district or school are, on average, out-performing the super-subgroup students in other similar districts 
or schools across the state.® Similarly, a negative and statistically significant estimate indicates that, relative 
to model predictions, the super-subgroup students in the district or school are, on average, under-performing 
the super-subgroup students in other similar districts or schools. 


Implication of this is that outlying students below the 15 percentile may have negative NCE values, while 
students above the 99 percentile may have NCE values greater than 100. 

7 With the implementation of MSIP6, FRL eligibility will be replaced with direct certification (from Social 
Services) of free lunch eligibility as a super-subgroup criterion. 

8 This is an additional model refinement introduced in 2018. In prior years, the super-subgroup measures 
were re-centered in such a way that the unit’s super-subgroup students were compared to the average non- 
super-subgroup students in the state and provided a measure of achievement gap closing across student 
subgroups. 
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Appendix H - Sample 2019 Annual Performance Reports 


The 2019 APR Summary Report will be reported in a format similar to the draft below: 


é M issouri 2019 MSIP5 District/Charter Transitional APR Summary Report - Secured 


‘@ DEPARTMENT OF ELEMENTARY & SECONDARY 


| EDUCATION 


Embargoed until October 8, 2019 


Std. Name 
Std. Substandard Metrics 
a3 Academic Achievement Are students making achievement gains over Are all students achieving at high levels? _Is the school, district or 
time? charter making 
improvements toward 
proficiency? 
En. Langage A | 
| a 
Matenates 
| a 
Social Studies NO DATA AVAILABLE - FIELD TEST ONLY 
2. Subgroup Achievement * Are students making achievement gains Are all students achieving at high levels? _Is the school, district or 
over time? charter making 
improvements toward 
proficiency? 
Er. Language ts 7 
| a 
Matemais ~ 
| a 
Social Studies NO DATA AVAILABLE - FIELD TEST ONLY 


* Subgroup achievement includes those subgroups which have historically performed below the state total. This is a single count of students from the following subgroups: Black, Hispanic, low 
income students, students with disabilities and English learners. 


Report as of- 8/28/2019 


PROD/2019 00S-001-SO-MSIP5-LEA-Summary for Annual Performance Report 1 


Changes to the Summary Report include the following: 


1. The new report will move growth to the beginning of the report in preparation for a focus on growth 
in MSIP 6. 
2. District and charter data will be presented using visualization. State averages will also be included to 
provide reference for comparison. 
3. Questions have been included to help provide context for the data presented. 
No points or percentage of points earned will be calculated for the report. 
5. Districts seeking reclassification or charter schools in the renewal process may request generation of 
an APR that includes points. 
e = Allrequests must be made on district or charter letterhead and signed by the 
superintendent; 
e =Adistrict or charter may request the calculation and reporting of points for their 
institution only; 
e Acharter school sponsor may request the calculation for all schools in their portfolio; 
and 


- 
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e Districts and charter schools may request the calculation of points from November 12- 
25. 
6. Districts or charter schools who have met the requirements for program expansion will have those 
points added to the calculation. 


The 2019 APR Supporting Data Report will not include the points earned, percentage of points earned or 
additional points earned for CTE program expansion. The remainder of the data in this report will 
continue to be reported in the same way as prior reports. 


2018 MSIP5 District/Charter Transitional APR Supporting Data Report - Secured 
Final 


To Summary Data Academic Achievement | Subgroup Achievement | CCR-HSR | Attendance | Graduation Rate 


1. Academic Achievement 2017 * 


% Prof or NCE |% Prof or % Prof or NCE 
notanLangwge ts | ae | MP | Se | * han | MP | Se | | | Soe 
Stas | 


[3357 | Appracting | cos [3307] 467 | sozm [sso] a5 | ser [3303] 


Progress | 12 | Approaching | Prior 2 Yr NCE Avg = 45.8 Current 2 Yr NCE Avg = 47.0 
Growth [047s | Exceeding 


3 Yr Progress = Average(Current NCE and Year 2 NCE) - Average(Year 2 NCE and Year 3 NCE) 


E % Prof or % Prof or % Prof or NCE 
merc | | Se |” | MP | Se | | | Se | 


Sats F 3163 | Avmroaching | 400% [221] «98 | ae0x [a1e5] «21 | «ox [009] 
— [11 [Approaching | Pror2VeNCEAug=405 | Guenl2VeNCE Aug =506 | 
Growth 5137S | exceeding — |S 


3 Yr Progress = Average(Current NCE and Year 2 NCE) - Average{Year 2 NCE and Year 3 NCE) 
a Se es 


Status 357.9 On Track 61.4% 357.2 60.4% 61.0% 357.2 
Progress |} 00 | ~~ Floor | Prior 2 Yr MPI Avg = 358.3 Current 2 Yr MPI Avg = 358.3 


3 Yr Progress = Average(Current MPI and Year 2 MPI) - Average(Year 2 MPI and Year 3 MPI) 


* Ai and E2 were excluded in 2017. New ELA and MA assessments in 2018. Direct comparison of MPI and proficiency rates across years is not 
advisable. 
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Glossary 


—_——————————————————— Oo ss 
Academic Achievement Targets 

Academic achievement targets are based on the goal of improving total student proficiency levels on state 
assessments by 25 percent by 2020. Student Gap Group targets are based on the goal of cutting the 
achievement gap in half for students in historically under-performing subgroups (students with disabilities, 
English language learners, low-income students, black students, and/or Hispanic students). 


Accountable Student 
All students enrolled during the testing window. Excludes in U.S. less than a year (recently arrived) students 
from ELA only. 


Adjusted Cohort Graduation Rates 
All groups (districts, schools, and subgroups) are expected to make steady progress toward a goal of 92 
percent for the five-year cohort graduation rate by 2020. 


Annual Benchmark Target (On Track) 
The target for the group in the current year needed for the group to remain on track toward reaching the 
2020 goal. 


Direct Certification 
Students eligible for free lunch without having to fill out free and reduced lunch forms. Based on lists 
obtained from social services, including SNAP and TANF. 


Exception Codes 

EOCEX2 may only be used for students who received content out-of-state; in a private, parochial or home 
school. 

EOCEX3 can only be used to exempt the government EOC. Reserved for students who take the MAP-A 
assessment the government EOC. May not be used with any other EOC assessment. 

EOCEX4 may only be used for a student who took the content in another Missouri district, but was not 
assessed. 


FAPE 
Free and appropriate public education as required under Section 504 of the Rehabilitation Act of 1973. 


Full Academic Year 

Districts are required to test all enrolled students. All scores are reported but only scores of those students 
who have been enrolled a “Full Academic Year” in a district and/or building will be included in the calculation 
for the APR score. A full academic year is defined as any student who is enrolled from the last Wednesday in 
September through the MAP administration, without transferring out of the district or building for a 
significant period of time and re-enrolling. A significant period is considered “one day more than half of the 
eligible days between the last Wednesday in September and the test administration”. This applies to each 
level independently. For example, a student who is coded as “In building less than a year” but was in the 
district a full academic year is excluded from the building totals but is included in the district totals. 


Graduate Exit codes 
GO1 - Exit code used for students who graduate meeting regular diploma guidelines. 
GO3 - Exit code used for students who graduate without meeting the requirements of a regular diploma. 


Comprehensive Guide to MSIP 5 Page 69 


LND 

When an Accountable student does not receive a valid test score, the student receives an LND in place of an 
achievement level score. The percent for LND may not exceed five percent, as all districts and schools are 
required to assess at least 95 percent of their students on the assessments required by the MAP. 


Local Education Agency (LEA) 
LEA is the federal term which refers to “District” or “Charter,” used interchangeably and have a county- 
district code to generate a district level APR. 


MAP Achievement Levels and MPI Point Values 

Student performance on tests administered through the MAP is reported in terms of four achievement levels; 
below basic, basic, proficient and advance. The levels of achievement describe a pathway to proficiency. 
Numeric values are assigned to each of the achievement level scores as follows when calculating the MPI: 


Below Basic 1 
Basic 3 
Proficient 4 
Advanced 5 


MAP Performance Index (MPI) 

MAP Performance Index (MPI) is used to develop scores within the Status and Progress metrics and to set 
academic achievement targets for district, school and student group achievement. Student performance on 
tests administered through the MAP is reported in terms of four achievement levels (Below Basic, Basic, 
Proficient and Advanced) that describe a pathway to proficiency. The MPI is a single composite number that 
represents the MAP assessment performance of every student by awarding points to each student based on 
the four achievement levels. The points for all students in the district, school or student group in a subject 
area are summed together, divided by the number of students in the group being measured and then 
multiplied by 100 rounded to the tenth. The result is the MPI for that group and subject. All assessment 
results from a single accountability year and for a single subject/content area are combined when generating 
the district, school or student group MPI. 


MPI (Three-year) 

The annual MPIs from the three most recent years are averaged and the mean, the three-year MPI, is used to 
determine whether the district, school, or subgroup has reached the target, is on track to reaching the target, 
is approaching the annual benchmark or is substantially not meeting the achievement targets set for the MAP 
content area. 


MPI (Cumulative) 

Districts, schools, and subgroups must have an average of at least 30 Accountable students in the group being 
measured in a given content area over a three-year period in order to generate scores for accountability. If this 
is not possible, the status measure is calculated by “pooling” three years of data and summing the number of 
Accountable students and the numbers of students in each achievement level across the three year period; the 
“pooled” count is used in the calculation used for determining Status and is referred to as the Cumulative MPI. 


N 
N is the number of students whose results are included in the calculation for a given student group. 


Normal Curve Equivalent (NCE) 
Normal Curve Equivalents are used in the calculation of Progress for ELA, MA, and Science contents. 
The NCE is used to compare assessments based on different standards. 
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Participant Student 
A student who receives a valid MAP score/achievement level, regardless of full academic year (FAY) status. 


Participation Rate 
All districts and schools are required to assess at least 95 percent of their students and subgroups on the 
assessments required by the MAP. 


Pooling 

Sum the total of Below Basic x 1, Basic x 3, Proficient x 4 and Advanced x 5 to calculate a new MPI instead of 
averaging MPI’s across years. Used when there are fewer than 30 reportable students in a given year. Pooling 
looks back across the prior three years. 


Progress 

Differentiated improvement targets are set for districts, schools, and subgroups based on the individual 
group’s two prior years of data. This method measures improvement by comparing two-year averages of data 
and setting targets through an MPI Gap or percent of required improvement. Year 1 and 2 are averaged, and 
years 2 and 3 are averaged; the averages are then compared to determine the amount of improvement. When 
three years of data are not available, (e.g., a new school is established) the available years will be used for 
reporting purposes. Differentiated improvement targets are set for districts, schools, and subgroups based on 
the individual group’s two prior years achievement. 


Reportable Student 
Participant students minus students in building (district) less than a full academic year (FAY) (participants - 
less than FAY). This group is the denominator that contributes to the calculation of the MPI. 


School 
“School” and “building” are interchangeable with attendance center, have a building code, and generate a 
building level APR. 


Status 
Status is a measurement of the districts or school’s level of achievement based upon the specific calculation of 
a standard. Status is divided into four levels; the target, on track, approaching, and floor. 


Selected Residential Facilities 

Selected residential facilities include: 

Institutions for neglected children and youth are public or private residential facilities, other than a foster 
home, that operates primarily for the care of children and youth who have been committed to the institution 
or voluntarily placed in the institution under applicable State law due to (1) abandonment; (2) neglect; or (3) 
death of their parents or guardians and have had an average length of stay in the institution of at least 30 
days. 


Institutions for delinquent children and youth are public or private residential facilities, other than a foster 
home, that operates primarily for the care of children and youth who have been adjudicated delinquent or in 
need of supervision and have had an average length of stay in the institution of at least 30 days. 


Student subgroups 

School and district accountability determinations are made for the "all students" group and for the “super 
subgroup.” Determinations are made for districts and schools that serve 30 or more students and for super 
subgroups of 30 or more students in a single accountability year. Multiple years of data are used for districts 
or buildings with fewer than 30 students. District and school reports are produced for the “all students” group 
and for up to nine additional subgroups: Asian/Pacific Islander, black, Hispanic, American Indian, white, 
multi-racial, students with disabilities, English language learners, and low-income students. 
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Super subgroup 

The new high needs group is an unduplicated count of all students in a district or school belonging to at least 
one of the following individual subgroups: black, Hispanic, students with disabilities, English language 
learners, or low-income students (eligible for FRL). The subgroups were selected based upon a review of the 
state’s student achievement data. 
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Acronyms 


ACCUPLACER® 


ACCUPLACER® 


A test used by many college and tech schools to 
asses an incoming student’s proficiency in 
reading, writing, English and MA. 


ACT® 


ACT® 


A test used for college admissions, indicating a 
student’s mastery of the core academic 
subjects. Scores range from 1 to 36. 


ACT WorkKeys® 


ACT WorkKeys® 


A job skills assessment that helps employers 
select, hire, train, develop, and retain a high- 
performance workforce. 


AMOs 


Annual Measurable Objectives 


Meaningful goals that are used to guide and 
support improvement efforts of districts and 
schools. 


AP 


Advanced Placement 


Classes available for which students may 
receive college credit upon passing the 
advanced placement exam. 


APR 


Annual Performance Report 


A report that reflects MSIP 5 Performance 
Standards results for districts and buildings 
used for planning and state accountability 
determinations. 


ASVAB 


Armed Services Vocational Aptitude 
Battery 


The ASVAB is a multiple-aptitude battery test 
that measures developed abilities and helps 
predict future academic and occupational 
success in the military. 


CCR 


College and Career Readiness 


A high school graduate with the necessary 
English and MA knowledge and skills— 
including, but not limited to, reading, writing, 
communications, teamwork, critical thinking, 
and problem solving—either to qualify for and 
succeed in entry-level, credit-bearing college 
courses without the need for remedial 
coursework, or in postsecondary job training 
for their chosen career (i.e. 
technical/vocational program, community 
college, apprenticeship, or significant on-the- 
job training). 


COMPASS® 


COMPASS® 


A computer-adaptive college placement test 
that evaluates students’ skill levels in reading 
writing skills, writing essay, MA, and English as 
a second language. 


CSIP 


Comprehensive School 
Improvement Plan 


A local board-approved plan that focuses on the 
improvement of the district's student 
achievement levels, programs, and services. 


CTE 


Career and Technical Education 


Appropriate courses of career and technical 
programs of study designed to improve the 
academic and technical skills of students 
participating in CTE programs through 
integration and provide students with strong 
experience in, and understanding of, all aspects 
of an industry. 
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EL 


English learners 


The term English language learners refers to 
students who were not born in the U.S. or 
whose native language is a language other than 
English. 


ELP 


English language proficiency 


Annual assessment of English proficiency of all 
students with limited English proficiency. 


EOC 


EOC assessments 


EOC assessments are criterion-referenced tests 
that are delivered to typically middle and high 
school students when the Course-Level 
Expectations for a particular course have been 
covered. 


FAY 


Full Academic Year 


Applied to Standards 1 and 2- (From 
Understanding your AYP 11-12) Student who is 
enrolled from the last Wednesday in September 
through the MAP administration, without 
transferring out of the building or district/LEA 
for a significant period of time (one day more 
than half of the eligible days between the last 
Wednesday in September and the test 
administration) and re-enrolling. 


FRL 


Free/Reduced priced lunch 


Students may qualify for a free or reduced 
priced lunch if their household falls within the 
limits of the federal income chart. 


GLA 


Grade-Level Assessments 


Grade-Level Assessments are augmented norm- 
referenced tests that are delivered annually 
each spring in communication arts and MA for 
grades 3-8, and science for grades 5 and 8. 


IB 


International Baccalaureate 


International Baccalaureate is a rigorous 
academic program of studies designed to offer 
students a curriculum that will prepare them 
for universities around the world and is 
sponsored by the International Baccalaureate 
Organization (IBO) based in Geneva, 
Switzerland. 


IEP 


Individualized Education Program 


A written statement that is developed, 
reviewed, and revised in accordance with IDEA 
for a particular child with a disability as defined 
by IDEA and addresses the child’s unique needs 
as related to education. 


IRC 


Industry Recognized Credential 


A portable, recognized credential (tangible 
evidence) that validates an individual has 
successfully demonstrated skill competencies 
in a core set of content and performance 
standards in a specific set of work-related 
tasks, single occupational area, or a cluster of 
related occupational areas. 


LEA 


Local Education Agency 


The term for public elementary and secondary 
school districts and other elementary and 
secondary schools operated at public expense 


and under a publicly appointed or elected 
board. 
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LND 


Level Not Determined 


The percent of students for whom the district is 
accountable but do not receive a valid MAP 
score in a subject or content area. 


MAP 


Missouri Assessment Program 


The statewide student assessment program 
developed in response to adoption of the 
Outstanding Schools Act in 1993 (Section 
160.518, RSMo). 

(grade-level, EOC, and MAP-A) 


MAP -A 


Map-Alternate 


Missouri's Alternate Assessments for students 
with the most severe cognitive disabilities. 


MLS 


Missouri Learning Standards 


The Missouri Learning Standards define the 
knowledge and skills students need in each 
grade level and course for success in college, 
other post-secondary training and careers. 
These expectations are aligned to the Show-Me 
Standards, which define what all Missouri high 
school graduates should know and be able to 
do. 


MPI 


MAP Performance Index 


The MPI is a single composite number that 
represents the MAP assessment performance of 
every student by awarding points to each 
student based on the four achievement levels. 
The MPI is a calculation used to determine 
whether the district, school, or subgroup is 
meeting the target, is on track to meeting the 
target, is approaching the annual benchmark, 
or is substantially not meeting the state 
performance targets. 


MSIP 5 


The fifth version of the Missouri 
School Improvement Program 


A system of accountability used by the State of 
Missouri that holds districts accountable for 
student achievement. 


NAEP 


National Assessment of Educational 
Progress 


A nationally representative and continuous 
assessment of what America’s students know 
and can do in various subject areas. It is 
commonly known as the nation’s report card. 


PLTW 


Project Lead the Way 


A high school program that provides students 
with real-world learning and hands-on 
experience. The program is for students 
interested in engineering, biomechanics, 
aeronautics, biomedical sciences and other 
applied MA and science arenas. 


ICAP 


ICAP - Individualized Career 
Academic Plan) 


A student’s scope and sequence of coursework 
and co-curricular experiences based on chosen 
educational and career goals; relies on the 

school’s implementation of a Program of Study. 


SAT® 


SAT® 


A standardized test designed to assess 
academic readiness for college, measuring the 
skills required for success in the 21st century. 
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The term for the state agency with primary 
SEA State Education Agency responsibility for elementary and secondary 
education in a state (in Missouri, this is DESE). 


It is the policy of the Missouri Department of Elementary and Secondary Education not to discriminate on the basis of race, color, religion, 
gender, national origin, age, or disability in its programs or employment practices as required by Title VI and VII of the Civil Rights Act of 
1964, Title IX of the Education Amendments of 1972, Section 504 of the Rehabilitation Act of 1973, the Age Discrimination Act of 1975 and 
Title II of the Americans with Disabilities Act of 1990. Inquiries related to Department employment practices may be directed to the Jefferson 
State Office Building, Human Resources Director, 8th floor, 205 Jefferson Street, P.O. Box 480, Jefferson City, Missouri 65102-0480; telephone 
number 573-751-9619 or TYY 800-735-2966. Inquiries related to Department programs and to the location of services, activities, and 
facilities that are accessible by persons with disabilities may be directed to the Jefferson State Office Building, Office of the General Counsel, 
Coordinator-Civil Rights Compliance (Title VI/Title IX/504/ADA/Age Act), 6th Floor, 205 Jefferson Street, P.O. Box 480, Jefferson City, MO 
65102-0480; telephone number 573-526-4757 or TTY 800-735-2966, civilrights@dese.mo.gov. 
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